Routing Games
Nonatomic and atomic selfish routing; equilibrium (Wardrop) flows; nonlinear Pigou example and Braess's Paradox; the AAE example (PoA 5/2) and nonexistence in weighted atomic instances; marginal cost functions and the equivalence of optimal and equilibrium flows (Corollary 18.10); the Beckmann potential and existence/essential uniqueness (Theorem 18.8); Rosenthal's potential and existence for unweighted instances (Theorem 18.12); potential-function PoA bound (p+1 for degree-p polynomials); the Pigou bound, variational inequality and its tightness (Theorem 18.21, 4/3 affine, about p/ln p polynomial); bounds on Braess's Paradox; atomic affine PoA (3+sqrt5)/2 via Cauchy–Schwarz (Theorem 18.23); marginal cost (Pigouvian) taxes; capacity augmentation, equilibrium beats optimum at double traffic (Theorem 18.29), M/M/1 capacity doubling
Motivation: routing without a central authority
Most of the literature on the inefficiency of equilibria concerns routing. The practical question is how to route traffic in a large network, like the Internet, with no one in charge. Routing games model two settings:
- source routing: each end user picks a full route;
- distributed, congestion-sensitive shortest-path routing. If each edge’s length is set to its current congestion cost , shortest-path routing sends traffic exactly as selfish routing would (Bertsekas–Tsitsiklis).
IntuitionThe central question
When every unit of traffic takes its own cheapest route, how much worse is the total delay than the best possible routing — and what, besides the cost functions, does that loss depend on?
The chapter studies two models:
| Nonatomic | Atomic | |
|---|---|---|
| players | a continuum; each controls negligible traffic | players; player routes on one path |
| generalizes | Pigou’s example (inefficiency-of-equilibria) | finite games from Chapter 1 |
| equilibria exist? | always | not always (weighted); yes if unweighted or affine |
| unique? | essentially (all have equal cost) | no |
| affine PoA | unweighted; weighted | |
| main PoA technique | variational inequality + Pigou bound | per-player deviation + Cauchy–Schwarz |
The models look alike on the surface, but different techniques are needed to analyze them.
Nonatomic selfish routing
DefinitionNonatomic instance
- A directed graph , parallel edges allowed, with commodities .
- is the set of – paths, assumed nonempty, and .
- A flow is indexed by paths; is the traffic of commodity on .
- Traffic is inelastic: is feasible if for each . There are no edge capacities.
- Each edge has a cost function that is nonnegative, continuous, nondecreasing. Delay is the canonical example.
Edge and path costs. The load on an edge is , and a path costs .
DefinitionDefinition 18.1 — equilibrium (Wardrop) flow
A feasible is an equilibrium flow if for every commodity and all with : All used paths are cheapest, so all used paths of a commodity have equal cost.
IntuitionNegligible players
One infinitesimal driver switching paths doesn’t change any edge’s congestion. So “no one wants to switch” reduces to “everyone is already on a currently cheapest path.”
ExamplePigou, checked against the definition
- All traffic on the lower edge (): this is an equilibrium. The only alternative also costs 1.
- A 50/50 split is not an equilibrium. The upper edge is used at cost 1, but the lower edge now costs only .
RemarkRemark 18.2 — congestion games
No player set or payoff functions are written down. A player’s cost depends only on its path and the loads on that path, not on who else is there. Games with this property are congestion games, and working with flows directly is simpler.
FormulaSocial cost of a flow
The second form follows by expanding and swapping sums. A feasible flow minimizing is optimal. The objective is utilitarian, and PoA = equilibrium cost / optimal cost. Any equilibrium can be used, since all have equal cost (Existence and essential uniqueness).
Two warning examples
ExampleExample 18.3 — nonlinear Pigou
Pigou’s example with the lower edge changed to .
- Equilibrium: everything on the lower edge, cost 1.
- Optimum: on the upper edge, with cost as .
So PoA , growing roughly like (Exercise 18.1).
graph LR S["s"] -->|"c = 1"| T["t"] S -->|"c = x to the power p"| T
IntuitionWhy nonlinearity hurts
With a steep cost, the lower edge is nearly free until it is almost full, and then its cost shoots up. Selfish drivers fill it right up to the expensive point. The optimum diverts a sliver of traffic to keep the rest on the nearly-free part.
ExampleExample 18.4 — Braess’s Paradox
One unit of traffic from to .
(a) Original network. Routes and , each with one edge of cost and one of cost . Equilibrium: half on each route, everyone pays .
(b) Add a zero-cost edge . The route uses both cost- edges and never costs more than the old routes, and strictly less while any traffic avoids it. So everyone takes it, and everyone pays .
Adding a free road made everyone worse off.
graph LR S["s"] -->|"x"| V["v"] V -->|"1"| T["t"] S -->|"1"| W["w"] W -->|"x"| T V -.->|"0, added edge"| W
WarningMore capacity is not always better
Braess shows the naive intuition fails even with affine costs. In network (b) the optimum is the old equilibrium (cost ), so PoA , the same as Pigou. That is no coincidence; see Remark 18.22 below.
RemarkPhysical analogue (Cohen–Horowitz)
Two springs in series, joined by a short taut string, with slack strings providing parallel paths. Cutting the taut string makes the hanging weight rise. Force plays the role of traffic, and extension the role of cost. The rise equals the equilibrium improvement from deleting the zero-cost edge.
Atomic selfish routing
DefinitionAtomic instance
Same ingredients, but it is a finite game. Player routes all units on one path . A flow is indexed by player and path, and it is feasible if each player puts on exactly one path. Different players may share a source–sink pair. and are defined as before.
DefinitionDefinition 18.5 — atomic equilibrium flow
A feasible is an equilibrium if for every player and all with : where moves player ‘s from to . These are pure Nash equilibria.
WarningThe deviator’s own traffic counts
The comparison is against , with ‘s traffic added to the new path. A nonnegligible player sees its own congestion, which is exactly what the nonatomic definition ignores.
Unweighted instances are those where all are equal.
ExampleExample 18.6 — the AAE example (Awerbuch–Azar–Epstein)
A bidirected triangle on . Edges and cost ; the other four edges cost . Four unit-traffic players:
| Player | Route | One-hop path | Two-hop path |
|---|---|---|---|
| 1 | |||
| 2 | |||
| 3 | |||
| 4 |
- All one-hop: each costly edge has load 1, for total cost 4. This is optimal and an equilibrium.
- All two-hop: loads are : 2, : 2, : 1, : 1. Players 1 and 2 pay ; players 3 and 4 pay . Total 10. It is an equilibrium: each one-hop alternative now costs exactly as much as the current route (3 for players 1–2, 2 for 3–4).
PoA , with affine costs, where nonatomic instances never exceed .
graph LR U["u: sources of players 1, 2"] -->|"x"| V["v"] U -->|"x"| W["w"] V -->|"0"| U W -->|"0"| U V -->|"x"| W W -->|"x"| V
ExampleExample 18.7 — no equilibrium in a weighted instance
A four-vertex network with polynomial edge costs and two players from to , with and . The paths are , , , . The unique best responses cycle:
- player 2 on or ⇒ player 1 best-responds with ;
- player 2 on or ⇒ player 1 best-responds with ;
- player 1 on ⇒ player 2 best-responds with ;
- player 1 on ⇒ player 2 best-responds with .
Following these around gives no fixed point, so there is no pure equilibrium.
NoteVerification left to the reader
The chapter leaves checking (1)–(4) as an exercise. The example is due to Goemans et al. (2005).
Existence and essential uniqueness
Optimal flows are equilibria for marginal costs
Assume each is convex and continuously differentiable. This is edge ‘s contribution to .
DefinitionMarginal cost function
Example: gives .
IntuitionTwo terms, two audiences
is what the marginal user pays itself. The term is the extra delay it imposes on the units already there. A selfish user sees only the first term.
PropositionProposition 18.9 — characterization of optimal flows
is optimal iff for every and all with : .
NoteProof omitted
These are the first-order (KKT) conditions for a convex program with nonnegativity constraints (Bertsekas 1999, ch. 2).
CorollaryCorollary 18.10 — optimal = equilibrium for marginal costs
is optimal for iff it is an equilibrium flow for .
| Instance | Marginal costs | Optimal flow from “equilibrium for “ |
|---|---|---|
| Pigou | and | equalize at 1: split |
| nonlinear Pigou | and | on the lower edge |
| Braess (b) | on the cost- edges | half on each outer route; all three paths have marginal cost 2 |
The Beckmann potential
Invert Corollary 18.10. We want a function whose minimizers are equilibria. Replace by some with , i.e. . This is convex and automatically, since is continuous and nondecreasing.
FormulaNonatomic potential function
| Component | Detail |
|---|---|
| Signature | |
| Domain | a routing of all traffic |
| Codomain | the “area under each edge’s cost curve up to its load” |
| Compare | cost charges every unit on the final cost ; charges the -th unit the cost it saw on arrival |
PropositionProposition 18.11 — equilibria minimize
A feasible flow is an equilibrium iff it is a global minimum of .
ProofProposition 18.9 applied to
Apply Proposition 18.9 with replaced by , which is convex and . Its “marginal cost” is , so the optimality condition for reads “used paths minimize ,” which is exactly Definition 18.1.
∎
TheoremTheorem 18.8 — existence and essential uniqueness
For every nonatomic instance:
- (a) an equilibrium flow exists;
- (b) if are equilibria, then for every edge.
Hence all equilibria have equal cost, and PoA = PoS.
ProofWeierstrass for existence; convexity for uniqueness
Step 1: Existence. Feasible flows form a compact subset of , and is continuous. By Weierstrass, attains its minimum, which is an equilibrium by Proposition 18.11.
Step 2: is convex. Each summand is convex because is nondecreasing.
Step 3: The chord between two minimizers is flat. For equilibria , every is feasible, and
Both endpoints are global minima, so equality must hold for all .
The key step: a sum of convex functions is linear along a segment only if each summand is. So each is linear between and , which forces to be constant there. So .
∎
WarningUniqueness is of costs, not flows
Two equilibria can route traffic differently. What is unique is every edge’s cost, and hence every path cost and the total cost.
Atomic existence: the Rosenthal potential
The AAE example rules out uniqueness, and Example 18.7 rules out existence in general. There are two escapes: restrict the instances (here), or relax the equilibrium concept (Remark 18.26).
TheoremTheorem 18.12 — unweighted atomic instances have equilibria
If every equals a common , an equilibrium flow exists.
FormulaRosenthal’s potential (take )
This is the discrete version of (18.3): the integral becomes a sum over the “arrival order” of units on each edge.
ProofThe potential exactly tracks a deviator’s cost change
Step 1: A minimizer exists. Finitely many players with finitely many paths give finitely many flows. Let minimize .
Step 2: Suppose a profitable deviation. Player moves from to , producing with
Shared edges cancel.
Step 3: Compute . Edges in gain the term , edges in lose the term , and shared edges are unchanged. That is exactly the right side of (18.6).
The key step: so , contradicting minimality.
∎
RemarkRemark 18.13 — an exact potential
For every flow, player and deviation, the change in the deviator’s cost equals the change in . So best-response dynamics strictly lower and must terminate at an equilibrium. This is the defining property of potential games (Monderer–Shapley); more in Chapter 19.
RemarkRemark 18.14 — monotonicity not used
The proof never uses nondecreasing costs. This matters for network design games (Chapter 19), which are atomic routing games with decreasing per-user costs.
TheoremTheorem 18.15 — affine atomic instances have equilibria
With affine costs (), equilibria exist even when weighted.
NoteExercise 18.4
Same outline as Theorem 18.12, with a variant potential. Proved for weighted affine instances by Fotakis et al. (2005).
The price of anarchy: nonatomic
Headline: the PoA depends on the nonlinearity of the cost functions and nothing else: not network size, not topology, not the number of commodities. For any class of costs, the worst network is one that best imitates Pigou.
A first bound from the potential
TheoremTheorem 18.16 — potential function upper bound
If for all and , then PoA .
ProofSandwich cost between potential and potential
Let be an equilibrium and optimal.
- (a) The hypothesis, edge by edge.
- (b) minimizes (Proposition 18.11).
- (c) because is nondecreasing.
∎
IntuitionApproximately optimizing the right thing
Equilibria exactly optimize . If is within of the true cost , equilibria are within of optimal.
CorollaryCorollary 18.17 — polynomials
For polynomial costs with nonnegative coefficients and degree , , so PoA .
WarningNot tight
Example 18.3 gives only about , so the bound is off by a factor. Closing the gap needs a different technique.
The Pigou bound
DefinitionDefinition 18.18 — Pigou bound
For a nonempty class of cost functions,
with .
IntuitionReading (18.7) as a two-link network
Rate travels over a link with cost , next to a parallel link with constant cost . The numerator is the equilibrium, where everyone uses and pays . The denominator is the alternative that puts only on and the other on the constant link. is the worst Pigou-like ratio.
PropositionProposition 18.19 — the Pigou bound is a lower bound
If contains all constant functions, nonatomic instances with costs in have PoA arbitrarily close to .
ProofBuild the two-link network
Fix and . If , the ratio is (since is nondecreasing), so assume . Take two parallel – edges with costs and the constant , and traffic .
- All traffic on the -edge is an equilibrium, with cost : the alternative costs the same .
- Putting on the -edge and on the constant edge costs .
So PoA is at least the ratio. Take the supremum.
∎
NoteWeaker hypothesis suffices
The conclusion holds whenever is inhomogeneous, meaning for some (Exercise 18.5).
The variational inequality
PropositionProposition 18.20 — variational inequality
A feasible is an equilibrium iff for every feasible :
ProofFreeze the edge costs at their equilibrium values
Step 1: Define a linear cost. . This is the cost of when each edge’s cost is frozen at the constant .
Step 2: Restate the claim. By the second form, the proposition says: is an equilibrium iff minimizes .
Step 3: Minimizers of a linear cost. With constant costs, minimizes iff each commodity’s traffic uses only paths minimizing . Applied to , that is exactly Definition 18.1.
∎
IntuitionWhat the inequality says
An equilibrium is optimal for the frozen costs it creates. Once congestion is fixed at equilibrium levels, no rerouting can beat it.
Tightness
TheoremTheorem 18.21 — the Pigou bound is tight
Every nonatomic instance with costs in has PoA .
ProofPer-edge Pigou bound, then the variational inequality
Let be optimal and an equilibrium.
Step 1: Apply (18.7) edge by edge with and :
Step 2: Sum over edges.
- (a) Step 1 summed.
- (b) The variational inequality (Proposition 18.20): the second sum is .
The key step: the variational inequality lets the per-edge Pigou inequalities, each of which only knows about one edge, be summed into a network-wide bound.
∎
ImportantPigou-like examples are the worst case
Propositions 18.19 and 18.21 together: for essentially every class of costs, the worst PoA over all multicommodity networks is achieved by a two-link Pigou-like network.
| Cost class | Extremal example | |
|---|---|---|
| affine | Pigou (Ex. 17.1) | |
| polynomials, degree , nonnegative coefficients | nonlinear Pigou (Ex. 18.3) |
NoteComputing is left as exercises
The affine value is Exercise 18.6. The chapter states the polynomial formula without derivation.
CorollaryRemark 18.22 — how bad can Braess get?
After adding edges, the old equilibrium is a feasible flow in the new network. So new-equilibrium / old-equilibrium PoA of the new network. With affine costs this is : adding edges can raise equilibrium cost by at most a factor , and Example 18.4 is the worst case. The same holds for the physical analogues.
The price of anarchy: atomic
WarningThe potential function method fails here
Theorem 18.16’s argument is about one equilibrium, the minimizer of the potential. When equilibria are non-unique (AAE), that bounds the price of stability, not the price of anarchy.
The substitute is a per-player version of the variational inequality: each player’s equilibrium path is no worse than its optimal path, counting its own added traffic. The analysis is done for affine costs.
TheoremTheorem 18.23 — affine atomic PoA
Atomic instances with affine costs have PoA .
NoteTightness (exercises)
- A weighted AAE variant shows is tight (Exercise 18.2(a)).
- For unweighted instances, a variant of the proof gives , matching AAE (Exercise 18.7).
LemmaLemma 18.24 — equilibrium condition
With , equilibrium (player on ) and optimal (player on ):
IntuitionWhy ""
If switched to , its own would be added to edges it doesn’t already use. On shared edges the load stays , which is , so the bound still holds.
LemmaLemma 18.25 — equilibrium inequality
ProofWeight by traffic, sum, swap order
- (a) Multiply (18.8) by and sum; the left side becomes .
- (b) for , since ‘s own traffic is part of .
- (c) Swap sums: .
The last expression is .
∎
ProofTheorem 18.23 — Cauchy–Schwarz on the error term
Step 1: Bound the cross term. Apply Cauchy–Schwarz to the vectors and :
using , so .
Step 2: Combine with (18.9) and divide by . Writing :
Step 3: Solve. For , squaring gives , so .
∎
WarningAtomic PoA explodes with degree
For degree- polynomial costs, the atomic PoA grows roughly like , exponential rather than about . Nearly matching lower bounds exist, so this is not an artifact of the proof (Awerbuch et al.; Olver).
RemarkRemark 18.26 — when equilibria may not exist
For polynomial costs, the bound extends three ways:
- to all pure equilibria when they exist;
- to mixed Nash equilibria, which always exist by Nash’s theorem, in expected cost;
- to sink equilibria, which always exist in finite games and are motivated by best-response dynamics (Goemans et al.).
NoteAtomic splittable model (open)
If players may split their fractionally, each internalizes its own congestion but not others’. A single player controlling everything routes optimally. Equilibria can be counterintuitive (Exercise 18.9). Early claims that nonatomic bounds carry over were refuted in multicommodity networks (Cominetti et al.). Tight bounds are open.
Reducing the price of anarchy
With highly nonlinear costs the PoA is large. Can modest intervention, short of imposing the optimum, fix this? (This is the design question from inefficiency-of-equilibria.)
Marginal cost pricing
Add a nonnegative tax on each edge. Users minimize cost plus tax, so an equilibrium of is an equilibrium of with .
DefinitionMarginal cost (Pigouvian) tax
For a flow and differentiable costs, set .
- is the extra delay one more user causes each user of ;
- is how many users suffer it.
This is exactly the term that selfish users omit from the marginal cost .
TheoremTheorem 18.27 — marginal cost taxes induce the optimum
If each is convex and , is optimal, and , then is an equilibrium of . So PoA becomes 1.
ProofImmediate from Corollary 18.10
At , . By Corollary 18.10, is an equilibrium for the costs . With taxed costs, path costs at coincide with marginal path costs, so the same equilibrium conditions hold at .
∎
NoteWeaker hypotheses
The theorem holds without the convexity assumption. More on pricing in Chapter 22.
RemarkExternality pricing again
Charging each user the harm it imposes on others is the same principle as the Clarke pivot in VCG (mechanism-design), here applied to delay.
Capacity augmentation
The PoA is unbounded for general costs (Example 18.3). A different kind of bound still holds for arbitrary costs.
ExampleExample 18.28 — nonlinear Pigou at double traffic
With , the optimum sends the extra over the constant edge, at a cost tending to . At , the optimum costs at least 1 for every , which is the equilibrium cost at .
TheoremTheorem 18.29 — equilibrium beats optimum at double traffic
If is an equilibrium for and is feasible for , then .
ProofInflate costs to at least their equilibrium values
Let be the cheapest – path cost under . By Definition 18.1, .
Step 1: Modified costs. Set and write for cost under . Then and .
Step 2: The inflation is cheap. is 0 for and at most for . So for all , and
Step 3: Under , every path costs at least . Since , we get for . So
The key step: combining, , so .
∎
CorollaryCorollary 18.30 — faster links beat central control
Let . The equilibrium cost for is at most the optimal cost for . This is equivalent to Theorem 18.29 (Exercise 18.8(a)).
ExampleM/M/1 delays: just double capacity
For (infinite for ), This is the M/M/1 function with capacity . Design principle: to outperform optimal routing, double every edge’s capacity.
NoteScope
A counterexample to Theorem 18.29 in atomic instances is in Roughgarden (2005a). Refinements for restricted cost classes are in Chakrabarty (2004) and Correa et al. (2005).
Quick reference
| Object | Statement | Note |
|---|---|---|
| Nonatomic instance | ; flows on paths; | costs nonnegative, continuous, nondecreasing |
| Equilibrium (Def 18.1) | used paths are cheapest | Wardrop equilibrium |
| Cost (18.1–18.2) | utilitarian | |
| Nonlinear Pigou (Ex. 18.3) | PoA , about | Exercise 18.1 |
| Braess (Ex. 18.4) | free edge: for everyone | PoA in new network |
| Atomic equilibrium (Def 18.5) | no player gains by moving its | pure Nash |
| AAE (Ex. 18.6) | equilibria of cost 4 and 10 | affine PoA |
| Ex. 18.7 | weighted atomic, no pure equilibrium | best responses cycle |
| Marginal cost | ||
| Prop 18.9 / Cor 18.10 | optimal for ⟺ equilibrium for | KKT |
| Beckmann potential (18.3) | equilibria = global minima (Prop 18.11) | |
| Thm 18.8 | existence; equal across equilibria | PoA = PoS |
| Rosenthal potential (18.5) | exact potential; unweighted existence (Thm 18.12) | |
| Thm 18.15 | affine atomic, even weighted, has equilibria | Exercise 18.4 |
| Thm 18.16 | ⇒ PoA | polynomials: (Cor 18.17) |
| Pigou bound (18.7) | lower bound (Prop 18.19) | |
| Variational inequality (Prop 18.20) | equilibrium optimal for frozen costs | |
| Thm 18.21 | nonatomic PoA , tight | independent of topology |
| values | affine ; degree : | Pigou / nonlinear Pigou extremal |
| Remark 18.22 | affine Braess increase | Ex. 18.4 is worst |
| Lemma 18.24 | per-player deviation | |
| Lemma 18.25 | ||
| Thm 18.23 | affine atomic PoA | tight weighted; unweighted |
| Atomic polynomial PoA | about | exponential; tight up to lower-order terms |
| Remark 18.26 | extends to mixed and sink equilibria | |
| Pigouvian tax (Thm 18.27) | induces | PoA |
| Thm 18.29 | eq. cost at opt. cost at | any costs, nonatomic only |
| Cor 18.30 | equilibrium optimum | M/M/1: double capacity |
Facts to keep to hand
- Equilibrium and optimum are the same object for different costs. Equilibria are optimal for with the externality term removed, and optimal flows are equilibria for . Pigouvian taxes add back exactly the missing term, and the potential is what you get by integrating instead of differentiating .
- Every nonatomic PoA bound follows one recipe: the variational inequality (equilibrium is optimal for frozen costs) plus a per-edge inequality ((18.7) or the potential sandwich). The network enters only through the variational inequality, which is why topology never matters.
- Every atomic PoA bound follows another: a per-player deviation inequality with "", weighted by and summed (Lemma 18.25), then Cauchy–Schwarz to control the cross term .
- Potential functions give existence and PoS, not PoA. In nonatomic games they coincide because the potential is convex and equilibria are essentially unique. In atomic games they don’t.
- Atomicity costs a lot. Affine: or . Degree : about . Existence can fail, uniqueness always can, and capacity augmentation fails.
- The worst case is always small. Nonatomic: two parallel links (Pigou). Atomic affine: a triangle (AAE). Braess’s Paradox is bounded by the same as Pigou.
- Two cheap fixes, both nonatomic. Tax the externality, which gives the exact optimum. Or double the capacity (twice the traffic, or ), which beats optimal routing for any cost functions.
References
- Nisan, Roughgarden, Tardos, Vazirani, Algorithmic Game Theory — chapter 18 (Roughgarden)
Mentioned in
- Computational Evolutionary Game Theory
- Incentives And Information Security
- Incentives And Pricing In Communication Networks
- Learning, Regret Minimization, and Equilibria
- Network Formation Games And The Potential Function Method
- Selfish Load Balancing
- The Price Of Anarchy And Scalable Resource Allocation Mechanisms