Computational Aspects Of Prediction Markets

The information aggregation problem; partition model of knowledge, common prior, omniscient forecast; market mechanisms (call market, continuous double auction, market maker, parimutuel) and empirical record (IEM, marginal traders, HP); rational expectations equilibrium, fully revealing equilibria, efficient market hypothesis and no-trade theorems; combinatorial markets over 2^|E| states, complete markets, combined vs compound orders, conditional securities S_(phi|psi), order payoff vectors and the matching problem; divisible matching polynomial (LP) for O(log n) events and co-NP-complete in general (Theorem 26.6), indivisible NP- and Sigma_2^p-complete (Theorem 26.7); Bayesian-network-structured markets and operational completeness; automated market makers, the thin-market problem, market scoring rules and the logarithmic cost function with loss b ln|Omega|, quadratic cost function, sequential shared scoring rules; dynamic parimutuel markets with the share-ratio cost function; the Boolean market model, price formation, myopic truthful Bayesian traders, common knowledge of aggregates (Theorem 26.9), XOR non-convergence, weighted threshold functions as exactly the computable aggregates (Theorems 26.12–26.13), and convergence within n rounds (Theorems 26.14–26.15)

· 25 min read · 4,986 words

Motivation: aggregating scattered knowledge

DefinitionThe information aggregation problem

An aggregator wants a forecast of an uncertain variable, say the global average temperature in 2020. Many informants hold different, nonindependent pieces of relevant information. The goal is a mechanism that elicits and combines this information into a collective forecast, ideally equal to the omniscient forecast: what someone with direct access to everyone’s information would predict.

DefinitionPrediction market

The aggregator creates a security whose payoff depends on the outcome, e.g. $xx if the 2020 temperature equals xx, and lets informants trade it freely. Believers in global warming buy at or above today’s temperature; skeptics sell. The trading price is read as the collective forecast of the expected value.

Also called information markets, Arrow–Debreu securities, contingent claims, event futures, idea futures. (Time value of money ignored.)

IntuitionThe central question

A market can in principle turn private beliefs into a price that knows what everyone knows. But operating it may be computationally intractable, subsidizing it must be done with bounded loss, and even a well-run market may fail to compute the answer. Where exactly are these computational limits?

The chapter locates computation in three places:

WhereProblemSection
the auctioneermatching orders over exponentially many combined eventsCombinatorial prediction markets
the market makerupdating prices after every trade with bounded lossAutomated market makers
the market as a wholedoes the price converge to the right answer, and how fast?The market as a distributed computer

Background

The partition model of knowledge

DefinitionDefinition 26.1 — partition model

  • Ω\Omega is the set of states of the world. Exactly one state ω∈Ω\omega\in\Omega is true.
  • Agent ii‘s information is a partition πi\pi_i of Ω\Omega. She knows which cell contains the true state but can’t distinguish states within a cell.
  • The combined information π^\hat\pi is the coarsest common refinement of π1,…,πn\pi_1,\dots,\pi_n.

Usually a common prior P∈Δ(Ω)P\in\Delta(\Omega) is added. Agents form posteriors by conditioning PP on their cell.

ExampleFigure 26.1 — three base events

Events X1,X2,X3X_1,X_2,X_3 generate 8 states. For example, ω4=ωX1Xˉ2X3\omega_4 = \omega_{X_1\bar X_2X_3} means X1X_1 true, X2X_2 false, X3X_3 true. Agent ii knows only whether XiX_i holds, so π1={{ω1..ω4},{ω5..ω8}}\pi_1 = \{\{\omega_1..\omega_4\},\{\omega_5..\omega_8\}\}. Together the three agents pin down the state exactly: π^\hat\pi is the finest partition, into singletons.

Forecasts.

  • A forecast is an estimate of E[f(ω)]\mathbb{E}[f(\omega)] for a commonly known function ff.
  • An event is an f:Ω→{0,1}f : \Omega\to\{0,1\}.
  • A joint forecast is a joint distribution over several functions.
  • The omniscient forecast conditions PP on the true cell of π^\hat\pi.

ImportantAggregation is mechanism design

Each agent’s information is private. The task is a mechanism whose equilibrium output is as close as possible to the omniscient forecast (see mechanism-design). A market pays agents for moving the price toward the truth.

Mechanisms and evidence

MechanismHow trades happen
call marketbatch bids; clear at the mm-th or (m+1)(m+1)-th lowest price, or between (mm = number of sellers)
continuous double auctiontrade immediately whenever two orders cross, usually at the earlier bidder’s price
market maker / bookmakeralways willing to buy and sell at posted, changing prices
parimutuelwinners split the total pool in proportion to their stakes

Variables can be binary, discrete, continuous or joint, and combinatorial versions of each mechanism exist.

ExampleEmpirical record

  • Iowa Electronic Market (since 1988, real money, mostly elections): on average more accurate and less volatile than polls. It reacts within minutes, often before news spreads, even though individual traders are biased.
  • Marginal-trader hypothesis: accuracy comes from a few active, less biased, price-making traders, not from the average trader.
  • Options, futures and sports betting odds are accurate forecasts of their underlying variables.
  • Play-money markets (Hollywood Stock Exchange, NewsFutures, Foresight Exchange) match experts and sometimes real-money markets.
  • Lab experiments: with enough securities and practice, prices approach omniscient forecasts.
  • Field: HP’s internal sales market beat official forecasts. Microsoft and Google run internal markets.

NoteEvaluation is comparative

A market can’t surface information nobody has, so accuracy is judged only against other aggregation methods.

Rational expectations

WarningSecurities have no consumption value

People buy a security only because they expect to resell or cash it out higher. Prices carry information about others’ beliefs, which changes each trader’s demand. So the classical fixed-demand-curve model fails.

DefinitionDefinition 26.2 — rational expectations equilibrium (REE)

Traders are risk-neutral Bayesians with a common prior and private information πi\pi_i. Take π^\hat\pi to be the finest partition. An REE is a mapping P∗:Ω→RP^* : \Omega \to \mathbb{R} such that, in every state, if each trader conditions demand on πi\pi_i and on the price P∗(ω)P^*(\omega), the market clears at exactly P∗(ω)P^*(\omega). It is a self-fulfilling state-to-price correspondence.

IntuitionUnpacking the fixed point

Any nonconstant price map PP induces a partition πP\pi_P: seeing the price rules out states that would have produced a different price. Each trader’s effective valuation becomes E[v∣πi(ω),P(ω)]\mathbb{E}[v \mid \pi_i(\omega), P(\omega)], which yields a clearing price v~(ω)\tilde v(\omega). PP is an REE iff v~=P\tilde v = P: believing in the map and acting on it reproduces the map.

TheoremFully revealing equilibria

REE exist under fairly general conditions. Generically, there are fully revealing REE, with P∗(ω1)≠P∗(ω2)P^*(\omega_1) \ne P^*(\omega_2) whenever ω1≠ω2\omega_1 \ne \omega_2, so that πP∗=π^\pi_{P^*} = \hat\pi: the price reveals everyone’s combined information.

NoteCriticism

REE says nothing about how traders would learn or agree on P∗P^*. The price-formation process must be modelled separately. The market as a distributed computer shows it can fail.

DefinitionEfficient market hypothesis (strong form)

The price fully reflects all information relevant to the security’s value. This is the theoretical case for prediction markets: many small pieces of private information end up in the price.

WarningNo-trade theorems

In a fully revealing REE, everyone conditions on the same information, so they share posteriors and valuations, and nobody trades. More strongly, rational agents won’t trade even out of equilibrium, because a counterparty’s willingness to trade reveals information. Paradox: the price contains everyone’s information, but nobody trades to put it there.

ImportantWhy trade happens anyway

No-trade results are fragile. They need risk neutrality and common knowledge of full rationality. Real sources of expected profit: irrational traders, hedgers, liquidity traders, and a subsidizing market maker.


Combinatorial prediction markets

Setup. A finite set EE of Boolean base events X1,X2,…X_1, X_2,\dots (“gas costs more than $3”), linearly independent in the sense that no event is determined by the others. Then ∣Ω∣=2∣E∣|\Omega| = 2^{|E|}.

DefinitionComplete market

Let SωS_\omega pay $1 iff the state is ω\omega. A market is complete if traders can build a portfolio replicating any SωS_\omega. Classic results: complete markets can be guaranteed efficient.

CautionCompleteness is exponential

A complete market needs at least 2∣E∣2^{|E|} securities. With many base events, even listing them is impossible. There may be far fewer combinations traders care about, which raises two questions: is there a succinct representation for orders, and can matches be found in it?

Two forms of expressive bidding:

Order typeTrader saysAuctioneer problem
combined”this bundle of securities, each within its limit price, or nothing”like combinatorial auctions (Chapter 11), but bids are often divisible; called combined value trading
compound”a security on this Boolean formula over EE”22∣E∣2^{2^{\lvert E\rvert}} expressible events; a strict superset of combined orders

NoteExecution risk

Combined orders remove execution risk: prices moving midway through a planned series of trades and ruining the earlier ones.

Compound securities and the matching problem

DefinitionConditional security Sϕ∣ψS_{\phi|\psi}

For Boolean formulas ϕ,ψ\phi,\psi over EE:

  • pays $1 if ϕ∧ψ\phi\wedge\psi;
  • pays $0 if ψ∧¬ϕ\psi\wedge\neg\phi;
  • cancelled and refunded if ¬ψ\neg\psi.

The unconditional SϕS_\phi is Sϕ∣trueS_{\phi|\text{true}}.

DefinitionOrders and payoff vectors

An order oo = ”qq units of Sϕ∣ψS_{\phi|\psi} at price pp.” Here q>0q > 0 is a buy (accepting any price ≤p\le p) and q<0q < 0 a sell (any price ≥p\ge p). Divisible orders accept any fraction αq\alpha q with α∈(0,1]\alpha\in(0,1]; indivisible orders accept exactly qq or nothing. The payoff vector over states is

Υω=q⋅1ω∈ψ(1ω∈ϕ−p).\Upsilon^\omega = q\cdot\mathbb 1_{\omega\in\psi}\big(\mathbb 1_{\omega\in\phi} - p\big).

If the auctioneer accepts fractions αi\alpha_i, its surplus in each state is Υauc=−∑iαiΥi.\Upsilon_{\text{auc}} = -\sum_i\alpha_i\Upsilon_i.

DefinitionDefinitions 26.3 / 26.5 — the matching problem

Does there exist α\alpha with some αi>0\alpha_i > 0 such that Υaucω≥0\Upsilon^\omega_{\text{auc}} \ge 0 for every state ω\omega? That is, can the auctioneer accept a nonempty set of orders without risk, breaking even at worst?

  • Indivisible: αi∈{0,1}\alpha_i\in\{0,1\}.
  • Divisible: αi∈[0,1]\alpha_i\in[0,1].

ExampleExample 26.4 — two orders that match

∣E∣=2|E| = 2, with states ordered (X1X2, X1Xˉ2, Xˉ1X2, Xˉ1Xˉ2)(X_1X_2,\ X_1\bar X_2,\ \bar X_1X_2,\ \bar X_1\bar X_2).

  • Buy 1 of SX1X2S_{X_1X_2} at 0.4: Υ1=(0.6,−0.4,−0.4,−0.4)\Upsilon_1 = (0.6, -0.4, -0.4, -0.4).
  • Sell 1 of SX1S_{X_1} at 0.3: Υ2=(−0.7,−0.7,0.3,0.3)\Upsilon_2 = (-0.7, -0.7, 0.3, 0.3).
Υauc=−Υ1−Υ2=(0.1,1.1,0.1,0.1)≥0.\Upsilon_{\text{auc}} = -\Upsilon_1 - \Upsilon_2 = (0.1, 1.1, 0.1, 0.1) \ge 0.

The orders match. The auctioneer keeps $0.10 cash plus one unit of SX1Xˉ2S_{X_1\bar X_2}.

Complexity of matching

Let nn be the input size, which also bounds the number of base events.

O(log⁡n)O(\log n) base events (poly many states)unlimited base events (exponentially many states)
divisibleP (LP)co-NP-complete
indivisibleNP-completeΣ2p\Sigma_2^p-complete

TheoremTheorem 26.6 — divisible matching

Divisible matching is polynomial-time for O(log⁡n)O(\log n) base events and co-NP-complete in general.

ProofLP, a small certificate for infeasibility, and a SAT reduction

Step 1: The LP (few events). Variables 0≤αi≤10\le\alpha_i\le1. One constraint per state: ∑i−αiΥiω≥0.\sum_i -\alpha_i\Upsilon_i^\omega \ge 0. Maximize ∑iαi\sum_i\alpha_i. A match exists iff the optimum is >0> 0. With O(log⁡n)O(\log n) events there are polynomially many states, so the LP is polynomial. (The chapter notes this approach may miss matchings with exactly zero surplus.)

Step 2: In co-NP (many events). Now there are exponentially many constraints, but each is short and easy to evaluate. With m≤nm\le n orders, LP theory says that if the optimum is 0, some m+1m+1 constraints already force it. Guess them and solve the small LP. That is a polynomial certificate that no match exists.

Step 3: co-NP-hard, via SAT. Given a formula ϕ\phi, take its variables as base events and a single buy order for SϕS_\phi at 0.5.

  • ϕ\phi satisfiable: in a satisfying state the auctioneer pays out, giving surplus −0.5-0.5, so no fraction matches.
  • ϕ\phi unsatisfiable: the security never pays, so surplus is +0.5+0.5 in every state, and it matches.

The key step: a match exists iff ϕ\phi is unsatisfiable. So matching is as hard as UNSAT.

∎

TheoremTheorem 26.7 — indivisible matching

Indivisible matching is NP-complete for O(log⁡n)O(\log n) base events and Σ2p\Sigma_2^p-complete in general.

NoteProof omitted in the chapter

The chapter omits it for space.

IntuitionWhere the two sources of hardness come from

Indivisibility adds a combinatorial choice (which subset of orders), which gives the NP-type “exists” layer. Exponentially many states add a universal check (surplus ≥0\ge0 in every state), which gives the co-NP-type “for all” layer. With both, you get ∃∀\exists\forall, i.e. Σ2p\Sigma_2^p.

Compact markets: exploit independence

DefinitionBN-structured market

Suppose base events factor as a Bayesian network: Pr⁡(X1⋯X∣E∣)=∏k=1∣E∣Pr⁡(Xk∣pa(Xk)),\Pr(X_1\cdots X_{|E|}) = \prod_{k=1}^{|E|}\Pr(X_k\mid\mathrm{pa}(X_k)), where the parents pa(Xk)\mathrm{pa}(X_k) have smaller indices. Trade only the conditional securities SXj∣pa(Xj)S_{X_j\mid\mathrm{pa}(X_j)}, one per parent configuration. That is O(∣E∣⋅2max⁡j∣pa(Xj)∣)O\big(|E|\cdot 2^{\max_j|\mathrm{pa}(X_j)|}\big) securities, far fewer than 2∣E∣2^{|E|} when parent sets are small.

TheoremOperational completeness

A BN-structured market is operationally complete (its equilibrium is Pareto optimal for the traders present) if all traders’ risk-neutral independencies agree with the network’s. For traders with constant absolute risk aversion (exponential utility), agreement on Markov independencies suffices.

NoteStated without proof

Completeness in all circumstances still needs 2∣E∣2^{|E|} securities.


Automated market makers

Why not just a continuous double auction?

WarningTwo problems with pure order matching

  1. Thin markets. An informed trader may wait forever for a counterparty. Expecting none, traders don’t come: a chicken-and-egg breakdown. It is worst in combinatorial markets, where attention is spread over exponentially many securities.
  2. Revealing intent. Posting a limit order tips off others. Traders play a zero-sum game with each other, so no-trade logic bites.

DefinitionMarket maker

An agent always ready to trade at posted bid and ask prices, which may be equal. It bridges buyers and sellers who arrive at different times.

ImportantSubsidy defeats no-trade

The market maker can lose money, which is a deliberate subsidy. With a subsidy, the no-trade theorems no longer apply, so informed traders can rationally expect to profit. The loss must be bounded, which requires updating prices systematically after every trade.

Desiderata for an automated market maker:

  1. bounded (predictable) loss;
  2. informed traders are motivated to trade whenever their information would move the price;
  3. computing new prices after each trade is tractable.

Market scoring rules (Hanson)

A proper scoring rule pays for a probability report so that truthful reporting is optimal. Hanson turns any such rule into a market maker.

DefinitionCost-function market maker

There are ∣Ω∣|\Omega| mutually exclusive, exhaustive securities, and qjq_j is the total quantity of security jj held by traders. A cost function C(q)C(q) records total trader spending. Moving outstanding shares from qoldq^{\text{old}} to qnewq^{\text{new}} (any bundle, combined or compound order; negative entries are sells) costs C(qnew)−C(qold).C(q^{\text{new}}) - C(q^{\text{old}}). The instantaneous price of jj is ∂C/∂qj\partial C/\partial q_j. The winning security pays $1 per share.

ComponentDetail
SignatureC:R∣Ω∣→RC : \mathbb{R}^{\lvert\Omega\rvert}\to\mathbb{R}
Domainoutstanding shares of every outcome
Codomaintotal money collected from traders so far
Pricesthe gradient ∇C\nabla C, read as the market’s probability forecast

FormulaLogarithmic market scoring rule (LMSR)

C(q)=bln⁡(∑jeqj/b),pj=∂C∂qj=eqj/b∑keqk/b.C(q) = b\ln\Big(\sum_j e^{q_j/b}\Big),\qquad p_j = \frac{\partial C}{\partial q_j} = \frac{e^{q_j/b}}{\sum_k e^{q_k/b}}.

The maximum loss is bln⁡∣Ω∣b\ln|\Omega|. Larger bb means more liquidity (more shares near the current price) but more risk. It is deployed at InklingMarkets, Net Exchange and Microsoft.

DerivationWhy LMSR’s worst-case loss is bln⁡∣Ω∣b\ln|\Omega|

Start at q=0q = 0, so C(0)=bln⁡∣Ω∣C(0) = b\ln|\Omega|. The market maker has collected C(q)−C(0)C(q) - C(0) and owes at most max⁡jqj\max_j q_j (if the most-held outcome wins). Since C(q)≥bln⁡emax⁡jqj/b=max⁡jqjC(q)\ge b\ln e^{\max_jq_j/b} = \max_jq_j, net=C(q)−C(0)−max⁡jqj≥−bln⁡∣Ω∣.\text{net} = C(q) - C(0) - \max_jq_j \ge -b\ln|\Omega|. (This derivation is mine; the chapter states the bound.)

FormulaQuadratic market scoring rule

C(q)=∑jqj∣Ω∣+∑jqj24b−(∑jqj)24b∣Ω∣−b∣Ω∣,pj=1∣Ω∣+qj−qˉ2b.C(q) = \frac{\sum_jq_j}{|\Omega|} + \frac{\sum_jq_j^2}{4b} - \frac{(\sum_jq_j)^2}{4b|\Omega|} - \frac{b}{|\Omega|},\qquad p_j = \frac{1}{|\Omega|} + \frac{q_j - \bar q}{2b}.

WarningQuadratic is impractical

Prices are linear in quantities, so they would leave [0,1][0,1]. The maker can sell only a small fixed number of shares, and once one security hits its cap it can’t accept buys on the others. LMSR accepts arbitrarily large orders.

IntuitionSequential shared scoring rule

Equivalently, the maker starts with an initial probability estimate. Each trader pays the scoring-rule payment for the previous report and receives the payment for her own. Myopically, reporting truthfully is still optimal. The final trader is paid by the maker, so the maker’s loss is at most the maximum payment to the last trader minus the payment from the first.

graph LR
  M["Market maker: initial estimate"] -->|"trader 1 pays score of maker's report"| T1["Trader 1 reports"]
  T1 -->|"trader 2 pays score of trader 1's report"| T2["Trader 2 reports"]
  T2 -->|"..."| TN["Final trader reports"]
  TN -->|"maker pays final trader's score"| M

Dynamic parimutuel markets

DefinitionDynamic parimutuel market

In a parimutuel game, winners split the total pool in proportion to their shares. The dynamic variant makes share prices vary according to a cost function, so traders can sell before resolution. To the trader it acts like a market maker.

FormulaShare-ratio cost function

C(q)=κ∑jqj2,pj=κ qj∑kqk2.C(q) = \kappa\sqrt{\sum_j q_j^2},\qquad p_j = \frac{\kappa\,q_j} {\sqrt{\sum_kq_k^2}}.

It is the unique dynamic parimutuel cost function with pj/pk=qj/qkp_j/p_k = q_j/q_k (price ratios equal share ratios).

DerivationWith κ=1\kappa = 1: prices below 1, payoffs above 1

Price: pj=qj/∑qk2≤1p_j = q_j/\sqrt{\sum q_k^2}\le1. The pool is C(q)=∑qk2C(q) = \sqrt{\sum q_k^2}, so the payoff per winning share is C(q)/qj≥1C(q)/q_j\ge1. Hence a winning bet never loses money.

The mechanism is also arbitrage-free. The maker seeds initial shares qq with C(q)C(q) dollars, which is its maximum risk.

Market scoring ruleDynamic parimutuel
payout per winning sharefixed $1a share of the total pool (uncertain)
price as forecastdirect probabilityless direct
trading strategysimplermore complex
appealforecastingrisk-seeking gamblers

The market as a distributed computer

Turn the viewpoint inside out: treat market plus traders as a computational device. What can it compute, and how fast?

IntuitionWhere the computation happens

In the traders’ belief updates. Each trader observes the price, a signal combining others’ information, and merges it logically with her own private information. This also addresses REE’s gap: how are equilibrium prices reached? Plausible dynamics can get stuck at an uninformative equilibrium even when a fully revealing one exists.

The Boolean market model

DefinitionBoolean market

  • nn traders, where trader ii privately knows one bit xix_i. So Ω={0,1}n\Omega = \{0,1\}^n and πi\pi_i splits Ω\Omega by the value of xix_i.
  • A security FF pays $1 iff f(x)=1f(x) = 1, for a commonly known f:{0,1}n→{0,1}f : \{0,1\}^n\to\{0,1\}.
  • The traders’ combined information determines f(x)f(x), so an efficient market should converge to price f(x)f(x).

DefinitionPrice formation

Synchronous rounds. Each trader submits money bib_i and quantity qiq_i (no credit or short-sale limits). The market clears at p=∑ibi∑iqi.p = \frac{\sum_ib_i}{\sum_iq_i}. Trader ii ends with qi′=bi/pq_i' = b_i/p units and bi′=bi−p(qi′−qi)=pqib_i' = b_i - p(q_i' - q_i) = pq_i money: a net buy if p<bi/qip < b_i/q_i and a net sell if p>bi/qip > b_i/q_i. The price is announced, beliefs are updated, and the process repeats until nothing changes.

Simplification: qi=1q_i = 1 for all ii, so pp is the average bid.

NoteWhy force qi=1q_i = 1

  1. It forces trade, sidestepping no-trade theorems without modelling hedgers or subsidies explicitly.
  2. Known volumes help traders learn from prices. This arguably gives them too much power, yet convergence can still fail.

DefinitionAgent behaviour

Agents are risk-neutral, myopic (each round treated as the last), and bid truthfully their current expected value of FF. They share a common prior PP, update by Bayes’ rule, and this behaviour is common knowledge.

ExampleExample 26.8 — OR, first round

Two traders, uniform prior, f=x1∨x2f = x_1\vee x_2.

  • x1=0x_1 = 0: x2x_2 is equally likely 0 or 1, so trader 1 bids 0.50.5.
  • x2=1x_2 = 1: f=1f = 1 for sure, so trader 2 bids 11.

The first-round price is 0.750.75.

Knowledge dynamics and equilibrium

After round rr:

  • the common-knowledge set is SrS^r (states an outside observer, seeing only prices, considers possible);
  • trader ii‘s knowledge is Sir={y∈Sr:yi=xi}S_i^r = \{y\in S^r : y_i = x_i\}.

Start with S0=ΩS^0 = \Omega. The observer knows the map price1(⋅)\text{price}_1(\cdot) from states to first-round prices, so S1={y∈S0:price1(y)=p1}S^1 = \{y\in S^0 : \text{price}_1(y) = p^1\}, and so on. Knowledge only shrinks, so the process reaches an equilibrium (S∞,Si∞,p∞)(S^\infty, S_i^\infty, p^\infty) in finitely many rounds.

TheoremTheorem 26.9 — agreement at equilibrium

P(f(y)=1∣y∈S∞)=p∞,P(f(y)=1∣y∈Si∞)=p∞  ∀i.(26.1–26.2)P\big(f(y) = 1\mid y\in S^\infty\big) = p^\infty, \qquad P\big(f(y) = 1\mid y\in S_i^\infty\big) = p^\infty\ \ \forall i. \tag{26.1–26.2}

Every trader’s expectation equals the uninformed observer’s, and equals the price.

NoteStated without proof

It follows from known results on common knowledge of aggregates.

WarningAgreement ≠ aggregation

Traders can agree on an expectation strictly between 0 and 1 while their combined information determines f(x)f(x) exactly. Their knowledge sets may differ as long as the conditional expectations coincide.

ExampleExample 26.10 — XOR gets stuck

Two traders, uniform prior, f=x1⊕x2f = x_1\oplus x_2.

  • Trader 1: whatever x1x_1 is, f=1f = 1 iff x2=xˉ1x_2 = \bar x_1, which has probability 12\tfrac12. So she bids 0.50.5 regardless.
  • Trader 2 likewise always bids 0.50.5.

The price is 0.50.5, which reveals nothing about either bit. Nobody updates, so equilibrium is reached at p∞=0.5p^\infty = 0.5. Both traders agree (as Theorem 26.9 requires), yet f(x)f(x) is never revealed.

IntuitionWhy XOR fails

Each bid is a function of one bit, and the price is their sum. For XOR, each trader’s expected value is the same whatever her bit is, so the sum carries no signal. A function computable from sums of per-bit contributions must be linearly separable.

Computable aggregates are exactly threshold functions

DefinitionDefinition 26.11 — weighted threshold function

ff is a weighted threshold function iff there are reals w0,…,wnw_0,\dots,w_n with f(x)=1  ⟺  w0+∑i=1nwixi≥1.f(x) = 1 \iff w_0 + \sum_{i=1}^n w_ix_i \ge 1. OR is threshold (w0=0w_0 = 0, wi=1w_i = 1). XOR is not.

TheoremTheorem 26.12 — threshold ⇒ always computed

If ff is a weighted threshold function, then for every prior PP the equilibrium price of FF equals f(x)f(x).

TheoremTheorem 26.13 — non-threshold ⇒ sometimes not

If ff is not a weighted threshold function, some prior PP makes the price of FF fail to converge to f(x)f(x).

TheoremTheorems 26.14–26.15 — convergence time

  • For a threshold ff with nn inputs and any prior, the price reaches p∞=f(x)p^\infty = f(x) within at most nn rounds.
  • Some function CnC_n on 2n2n inputs, with some prior PnP_n, needs nn rounds in the worst case.

NoteProofs omitted

The chapter omits Theorems 26.12–26.15 for space. It notes that simulations suggest near-constant expected convergence time for almost every threshold function.

ImportantWhat a single security can compute

One market price computes precisely the functions a single linear threshold unit (a perceptron) computes. Anything else, such as XOR, needs several securities combined. How many is open.


Open questions

NoteCombinatorial markets

  • The bidder’s side: how to choose formulas, quantities and prices, possibly with penalties on bid complexity.
  • Less expressive bidding languages with polynomial matching that are still useful.
  • Heuristic or approximate matching; logical-reduction algorithms.
  • Permutation combinatorics (horse-race orderings: ”X1X_1 wins,” “top 3,” ”X1X_1 beats X2X_2”): languages with tractable matching.
  • Sharing auctioneer surplus with traders, and the incentives this creates.
  • Matching a single new order against a no-match book (the standard continuous double auction rule).
  • Computational equilibrium: can a market settle where no bounded agent finds an improvement, yet it isn’t a true equilibrium?

NoteMarket makers

  • For every polynomially matchable bidding language, is there a polynomial-time market-scoring-rule maker?
  • Market makers are online algorithms (see online-mechanisms): accept or reject orders one at a time under a worst-case loss budget. Can other online algorithms accept more orders for the same bound?

NoteMarkets as computers

  • Noisy prices, and misinformed or irrational traders: what is still computable?
  • Incremental recomputation when a few input bits flip.
  • A distributed-computing model of decentralized markets.
  • The complexity of traders’ belief updates.
  • Replacing the truthful-bidding assumption with game-theoretic rationality.
  • Average-case convergence over the prior.
  • The minimum number of threshold securities needed to implement a given function, and security designs that speed up convergence.

Quick reference

ObjectStatementNote
Aggregation problemelicit and combine private info into the omniscient forecastmechanism design
Partition model (Def 26.1)πi\pi_i partitions Ω\Omega; combined info π^\hat\pi = coarsest common refinementcommon prior PP
REE (Def 26.2)self-fulfilling map P∗:Ω→RP^*:\Omega\to\mathbb Rgenerically fully revealing
Efficient market hypothesisprice reflects all relevant informationfoundation for prediction markets
No-trade theoremsrational agents with common knowledge never tradebroken by hedgers, noise, subsidies
Complete marketneeds 2∣E∣2^{\lvert E\rvert} securitiescombinatorial blow-up
Sϕ∣ψS_{\phi\mid\psi}$1 if ϕ∧ψ\phi\wedge\psi, $0 if ¬ϕ∧ψ\neg\phi\wedge\psi, refunded if ¬ψ\neg\psicompound / conditional
Order payoffΥω=q 1ψ(1ϕ−p)\Upsilon^\omega = q\,\mathbb 1_\psi(\mathbb 1_\phi - p)
Matching∃α≠0\exists\alpha\ne0: −∑αiΥi≥0-\sum\alpha_i\Upsilon_i \ge 0 in every staterisk-free acceptance
Ex. 26.4buy SX1X2S_{X_1X_2}@0.4 + sell SX1S_{X_1}@0.3 ⇒ (0.1,1.1,0.1,0.1)(0.1, 1.1, 0.1, 0.1)match
Thm 26.6divisible: P (few events), co-NP-complete (many)LP; SAT reduction
Thm 26.7indivisible: NP-complete (few), Σ2p\Sigma_2^p-complete (many)
BN marketO(∣E∣ 2max⁡∣pa∣)O(\lvert E\rvert\,2^{\max\lvert\mathrm{pa}\rvert}) securitiesoperationally complete if independencies agree
AMM desideratabounded loss; incentive to trade; tractable updatessubsidy defeats no-trade
Cost-function makerpay C(qnew)−C(qold)C(q^{\text{new}}) - C(q^{\text{old}}); price ∂C/∂qj\partial C/\partial q_j$1 per winning share
LMSRC=bln⁡∑eqj/bC = b\ln\sum e^{q_j/b}, softmax pricesloss ≤bln⁡∣Ω∣\le b\ln\lvert\Omega\rvert
Quadratic MSRprices linear in qqonly small fixed purchases
Sequential scoringpay predecessor’s score, receive your ownequivalent to the cost-function form
Share-ratio DPMC=κ∑qj2C = \kappa\sqrt{\sum q_j^2}, pj/pk=qj/qkp_j/p_k = q_j/q_kpays a share of the pool
Boolean marketbits xix_i; security pays f(x)f(x); price = mean bid (qi=1q_i = 1)myopic truthful Bayesians
Ex. 26.8 (OR)bids 0.5 and 1 ⇒ price 0.75
Thm 26.9at equilibrium, all expectations = observer’s = p∞p^\inftycommon knowledge of aggregates
Ex. 26.10 (XOR)stuck at 0.5 foreveragreement without aggregation
Threshold functionf=1  ⟺  w0+∑wixi≥1f = 1 \iff w_0 + \sum w_ix_i\ge1linearly separable
Thms 26.12–26.13computable for all priors ⟺ threshold
Thms 26.14–26.15≤n\le n rounds; some instances need nn

Facts to keep to hand

  • Rational expectations promises aggregation; computation decides whether you get it. Fully revealing REE exist generically, but the auctioneer may face co-NP- or Σ2p\Sigma_2^p-hard matching, and natural price dynamics compute only threshold functions.
  • No-trade theorems explain why subsidies matter. In a zero-sum game among rational traders, willingness to trade reveals information and kills the trade. A bounded-loss market maker injects money so that informed trading becomes profitable. LMSR’s bln⁡∣Ω∣b\ln|\Omega| is literally the price of information.
  • Complexity has two independent layers. Indivisibility adds an “exists a subset” choice, and exponentially many states add a “for every state” check. Divisible with few states is P, and each added layer climbs one step, up to Σ2p\Sigma_2^p with both.
  • Structure is the escape from 2∣E∣2^{|E|}. Bayesian-network conditional securities give polynomially many instruments, and they are enough whenever traders’ independencies match the network.
  • A price is a sum, so it computes linear threshold functions. Each trader contributes a bid that depends on her information, and the price averages them. Functions that are not linearly separable (XOR) can leave every bid uninformative. One security acts like one perceptron.
  • Agreement is not aggregation. At equilibrium everyone agrees on the price (common knowledge of aggregates), but agreeing on 0.50.5 can coexist with the truth being fully determined by what they jointly know.
  • Market makers are cost functions whose gradient is the forecast. LMSR prices are a softmax, and the quadratic rule has linear prices, which breaks the [0,1][0,1] range. The share-ratio parimutuel pays from the pool. The sequential-scoring-rule reading explains why truthful moves are myopically optimal.

References

← All notes