Manipulation-Resistant Reputation Systems

Why reputation matters (ability revelation, moral hazard, adverse selection); the reputation-system pipeline and aggregation across users, time, and transitive trust; three threats (whitewashing, dishonest or missing feedback, phantom/sybil feedback); repeated Prisoner's Dilemma, discounted average payoff, Grim SPNE for delta >= 1/2, reputational vs personalized Grim; whitewashing, entry fees f >= 1/delta, the pay-your-dues (PYD) strategy and its social cost, noisy dynamic model and unavoidable mistrust of newcomers; peer-prediction method (Miller–Resnick– Zeckhauser) with common prior, signals, reference raters and the log scoring rule, truthful strict Nash equilibrium (Proposition 1), worked H/L example, non-truthful equilibria and extensions; transitive trust graphs, PageRank, max-flow (Advogato), Pathrank; monotonicity, symmetry, rank-strategyproofness impossibility; sybil strategies, value- vs rank-sybilproofness, no symmetric rank-sybilproof function (Theorems 27.5, 27.7), max-flow value-sybilproof but not rank-sybilproof (Theorem 27.8), Pathrank value- and rank-sybilproof (Theorem 27.9)

· 25 min read · 4,818 words

Motivation: trusting strangers online

The Internet enables interactions between parties with no common context. Their value depends on the partner’s ability and reliability. An online shopper may find better deals, or be defrauded with little redress.

Making each entity’s history visible does three jobs:

BenefitEconomic problem solved
reveals ability, so others choose partners and termsinformation
future visibility deters cheating or shirking nowmoral hazard
high-ability entities are distinguishable and rewarded, so they joinadverse selection

IntuitionThe central question

A reputation system is only as good as the histories it records and the identities it attaches them to. When participants can abandon bad names, shade or skip their feedback, and invent fake raters, which guarantees can a reputation system still provide — and which are impossible?

What a reputation system is

DefinitionReputation system

A system that collects, maintains and disseminates reputations: aggregated records of each participant’s past interactions. Records combine objective data (e.g., sale price) with subjective feedback (e.g., buyer and seller rating each other; peers reporting availability). Reputations are usually numeric summaries, for easy comparison.

graph LR
  I["Interactions between entities"] --> C["Collect objective data and feedback"]
  C --> U["Aggregate and update reputations"]
  U --> D["Disseminate reputations"]
  D --> I

Aggregation happens along three dimensions:

  1. across users: a statistic of everyone’s reports about AA;
  2. across time: a statistic of past reports;
  3. transitive trust: reports from highly reputed users weigh more.

NoteScope

Economic models in which actions link to outcomes only probabilistically, or with observation error, are “interesting and complex” but out of scope. The chapter studies threats to the system itself: how histories are collected and attached to identities.

DefinitionThree threats

  1. Whitewashing: take a new pseudonym and start over with a clean record.
  2. Incorrect feedback: don’t report it, or don’t report it honestly.
  3. Phantom feedback: feedback on interactions that never happened, often from sock puppets or sybils, identities created for the purpose.

Threats 1 and 3 both come from cheap pseudonyms.

ThreatModelRemedySection
whitewashingrepeated PD with random matchingpay-your-duesWhitewashing
dishonest or missing feedbackcommon-prior signal modelpeer predictionEliciting effort and honest feedback
dishonest and phantom feedbacktrust graphseeded, path-based rankingTransitive trust and sybils

Why reputations work: the repeated Prisoner’s Dilemma

DefinitionThe stage game

Bob: CCBob: DD
Alice: CC1, 11,\ 1−1, 2-1,\ 2
Alice: DD2, −12,\ -10, 00,\ 0

One-shot, DD is dominant, so the outcome is (D,D)(D,D).

FormulaDiscounted average payoff

πi=(1−δ)∑t=0∞δtπit,0≤δ<1.\pi_i = (1 - \delta)\sum_{t=0}^\infty \delta^t\pi_i^t,\qquad 0\le\delta<1. The factor (1−δ)(1-\delta) normalizes: getting 11 every round gives πi=1\pi_i = 1. δ\delta measures how much future rounds matter (think of interest rates).

DefinitionGrim trigger

Play CC until anyone has played DD, then play DD forever. (Grim,Grim)(\text{Grim}, \text{Grim}) is a subgame perfect Nash equilibrium (SPNE) when no player wants to deviate at any stage game.

ProofGrim is an SPNE iff δ≥1/2\delta\ge1/2

Step 1: One-shot deviations suffice (the single-deviation property from dynamic programming).

Step 2: Compare. Deviate at round 0: (1−δ)(2+0+0+⋯ )=2(1−δ)(1-\delta)(2 + 0 + 0 + \cdots) = 2(1-\delta). Comply: (1−δ)(1+δ+⋯ )=1(1-\delta)(1 + \delta + \cdots) = 1.

Step 3: Solve. Complying is optimal iff 1≥2(1−δ)1\ge2(1-\delta), i.e. δ≥12\delta\ge\tfrac12. The same holds at every round tt, since both sides scale by δt\delta^t.

∎

ImportantReputations need patience

If players don’t value the future enough (small δ\delta), no reputation system can constrain behaviour. Less harsh strategies, which punish for only a few rounds, can also sustain cooperation, for higher δ\delta.

DefinitionReputational Grim (random matching)

N+1N+1 players (NN odd) are paired at random each round. Everyone starts good, and stays good by playing CC against good partners and DD against bad ones. This is an SPNE for δ≥12\delta\ge\tfrac12: a deviator faces the same punishment as under full Grim.

WarningPrivate histories don’t scale

Without shared reputations, a player can punish only on her own encounters (personalized Grim, NN separate games). She meets a given partner about once every NN rounds, so the SPNE condition becomes δ≥1−12N,\delta \ge 1 - \frac{1}{2N}, which is unreasonably close to 1 for large NN. Shared histories are what make reputations work at scale. (Compare direct vs indirect reciprocity in p2p-incentives.)

NoteDerivation left as an exercise

The chapter gives 1−1/(2N)1 - 1/(2N) without derivation.

RemarkHeterogeneous abilities

Varying ability is modelled by different action sets. A commitment type has one action only (low types only DD, honest high types only CC), or CC may cost low types more. Strategic types choose actions to mimic high types. With noisy outcomes, strategic types can defect occasionally and hide among honest types who have bad luck.


Whitewashing

WarningCheap identities destroy Grim

A player can play DD, then re-register under a new name next round. Punishment never reaches the deviator.

Entry fees

DerivationThe fee needed to deter whitewashing: f≥1/δf\ge1/\delta

Charge ff to register. Whitewash once (defect, pay again, cooperate after):

π′=(1−δ)(2−f+δ(1−f)+δ2+δ3+⋯).\pi' = (1-\delta)\big(2 - f + \delta(1 - f) + \delta^2 + \delta^3 + \cdots\big).

Comply: π=(1−δ)(1−f+δ+δ2+⋯).\pi = (1-\delta)\big(1 - f + \delta + \delta^2 + \cdots\big). Then π−π′=(1−δ)(δf−1)\pi - \pi' = (1-\delta)(\delta f - 1). So π≥π′\pi \ge \pi' iff δf≥1  ⟺  f≥1δ.\delta f \ge 1 \iff f \ge \frac1\delta. δ≥1/2\delta\ge1/2 is still needed to stop deviation without whitewashing.

Pay your dues

Fees may be infeasible or politically unacceptable. Instead, charge a reputational fee.

DefinitionPay-your-dues (PYD)

  • vs a veteran who has never deviated from PYD: play CC;
  • vs a veteran who has deviated: play DD;
  • vs a newcomer: play DD, unless you are a newcomer too, in which case play CC.

Veterans get to exploit newcomers once; newcomers “pay dues” by cooperating while exploited.

IntuitionWhy this deters whitewashing

A whitewasher returns as a newcomer and gets exploited, which costs as much as the punishment it tried to escape. Newcomers must be penalized at least as much as deviators, because they are indistinguishable.

WarningAn unavoidable social cost

A veteran–newcomer pair plays (D,C)(D,C), with total payoff 2−1=12 - 1 = 1 instead of 22 for (C,C)(C,C). Making newcomers defect against each other too would give 00, which is even worse. So whitewashing imposes a cost on society that even the best equilibrium can’t avoid. Under PYD, every player still averages a discounted payoff of 1 (exercise).

A more realistic dynamic model

WarningThe naive model is too easy

If the population is fixed, every newcomer is a whitewasher. Always defecting on post-period-1 arrivals (and personalized Grim otherwise) is then fully efficient.

Add real turnover. αN\alpha N genuine newcomers arrive each period and as many random veterans leave. There is still a fragile equilibrium: play PYD while exactly αN\alpha N newcomers appear, and defect forever if more appear. One deviation collapses everything. Such knife-edge equilibria are artifacts of noiselessness and perfect rationality.

TheoremPYD is the most efficient equilibrium under noise (Friedman–Resnick)

Add noise: in any stage game, a player plays DD by accident with probability ϵ>0\epsilon > 0 and returns next period as a whitewasher. Then PYD yields the highest fraction of cooperative outcomes of any equilibrium.

NoteProof omitted

Showing PYD is an equilibrium uses dynamic programming. Optimality needs a careful stochastic analysis (Friedman–Resnick 2001), not reproduced.

ImportantDistrust of newcomers is the price of cheap pseudonyms

In practice PYD means mistrusting newcomers until they prove themselves. The only way to treat newcomers better is to make whitewashing harder for existing members than for genuine newcomers. For example: require a true name, give one free pseudonym, and restrict or charge for additional ones.


Eliciting effort and honest feedback

Subjective feedback has two problems:

ProblemCause
underprovisionforming and reporting an opinion takes effort; the benefit goes to others
dishonestyniceness or fear of retaliation suppresses negatives; conflicts of interest, or wanting to look like a good rater, distort reports

If objective outcomes are later revealed (weather, sports), reports can be scored against them; see prediction-markets. The hard case is no objective outcome: either none exists (product “quality”), or it exists but is private (breakdown frequency, known only to owners).

WarningRewarding agreement causes herding

Scoring raters by agreement with peers backfires. A rater with a bad experience of a seller with a stellar record still expects the next rater to report good, so she reports good too. This resembles herding and information cascades.

NoteMeta-moderation

Slashdot has users rate the raters. That is inefficient (effort diverted from rating content) and only pushes the incentive problem up one level.

RemarkCurrency of rewards

Scores can become money or discounts, but prestige often suffices: Slashdot “karma,” ePinions status, chess and bridge ratings.

The model

DefinitionSignal model

  • A product has a fixed type t∈{1,…,T}t\in\{1,\dots,T\} with a common prior Pr⁡0(t)>0\Pr_0(t) > 0.
  • Raters i∈Ii\in I, with ∣I∣≥3|I|\ge3, possibly countably infinite. Each privately observes a signal Si∈{s1,…,sM}S^i\in\{s_1,\dots,s_M\}.
  • Given the type, signals are i.i.d. with commonly known f(sm∣t)>0f(s_m\mid t) > 0, which differs across types (so signals are informative).
  • Raters report xix^i to a center, which has no independent information and pays transfers τi(x)\tau_i(x) based only on reports.
  • Raters are risk-neutral with utility linear in points.

DefinitionBest response and truthful equilibrium

xˉi\bar x^i is a best response if for every signal sms_m and every alternative report x^i\hat x^i:

ES−i[τi(xˉmi,xˉ−i)∣Si=sm]≥ES−i[τi(x^i,xˉ−i)∣Si=sm].(27.1)\mathbb{E}_{S^{-i}}\big[\tau_i(\bar x^i_m, \bar x^{-i})\mid S^i = s_m\big] \ge \mathbb{E}_{S^{-i}}\big[\tau_i(\hat x^i, \bar x^{-i})\mid S^i = s_m\big]. \tag{27.1}

Truthful revelation (xmi=smx^i_m = s_m) is a (strict) Nash equilibrium if truth is a (strict) best response when everyone else is truthful.

ExampleRunning example: two types, two signals

Pr⁡0(H)=Pr⁡0(L)=0.5\Pr_0(H) = \Pr_0(L) = 0.5, with f(h∣H)=0.85f(h\mid H) = 0.85 and f(h∣L)=0.45f(h\mid L) = 0.45. So Pr⁡(h)=0.65\Pr(h) = 0.65 and Pr⁡(l)=0.35\Pr(l) = 0.35.

Predicting another rater jj:

Pr⁡(Sj=h∣Si=l)=0.85⋅0.15⋅0.50.35+0.45⋅0.55⋅0.50.35≈0.54,\Pr(S^j = h\mid S^i = l) = 0.85\cdot\frac{0.15\cdot0.5}{0.35} + 0.45\cdot\frac{0.55\cdot0.5}{0.35} \approx 0.54, Pr⁡(Sj=h∣Si=h)=0.85⋅0.85⋅0.50.65+0.45⋅0.45⋅0.50.65≈0.71.\Pr(S^j = h\mid S^i = h) = 0.85\cdot\frac{0.85\cdot0.5}{0.65} + 0.45\cdot\frac{0.45\cdot0.5}{0.65} \approx 0.71.

The herding trap: even after seeing ll, rater ii thinks jj will probably see hh (0.540.54). A pure agreement reward would make her report hh.

Peer-prediction scoring

DefinitionDefinition 27.1 — strictly proper scoring rule

A rule T(s∣report)T(s\mid\text{report}) is strictly proper if a rater uniquely maximizes her expected score by reporting her true beliefs.

ExampleLogarithmic scoring rule

For a binary event with reported probability p^\hat p of hh: T(h∣p^)=ln⁡p^T(h\mid\hat p) = \ln\hat p and T(l∣p^)=ln⁡(1−p^)T(l\mid\hat p) = \ln(1 - \hat p). With true belief pp, the expected score pln⁡p^+(1−p)ln⁡(1−p^)p\ln\hat p + (1-p)\ln(1-\hat p) has first-order condition p^=p\hat p = p.

DefinitionPeer-prediction method (Miller–Resnick–Zeckhauser)

Assign each rater a reference rater r(i)≠ir(i) \ne i. The rater reports only her signal. The center infers her implied forecast of the reference rater’s report and scores it with the log rule:

τi∗(xi,xr(i))=T(xr(i)∣xi)=ln⁡Pr⁡0(Sr(i)=xr(i)∣Si=xi).(27.2)\tau_i^*\big(x^i, x^{r(i)}\big) = T\big(x^{r(i)}\mid x^i\big) = \ln\Pr_0\big(S^{r(i)} = x^{r(i)}\mid S^i = x^i\big). \tag{27.2}
ComponentDetail
Inputii’s report and the reference rater’s report
Inferred beliefposterior over Sr(i)S^{r(i)} given Si=xiS^i = x^i, computed by the center from the common prior
Outputlog-probability the inferred belief assigned to what r(i)r(i) actually reported (a penalty ≤0\le 0)
Not required of the raterany Bayesian computation

TheoremProposition 1 — truthful reporting is a strict Nash equilibrium

For any assignment r(i)≠ir(i)\ne i, truthful reporting is a strict Nash equilibrium of the simultaneous reporting game with transfers τi∗\tau_i^*.

ProofStrict propriety applied to the inferred forecast

Step 1: The reference rater is truthful. Then SiS^i is stochastically informative about r(i)r(i)‘s report.

Step 2: Rater ii‘s problem. With true signal s∗s^*, she chooses xix^i to maximize

∑n=1MT(sn∣xi) Pr⁡(Sr(i)=sn∣Si=s∗).(27.3)\sum_{n=1}^M T\big(s_n\mid x^i\big)\,\Pr\big(S^{r(i)} = s_n\mid S^i = s^*\big). \tag{27.3}

The key step: reporting xix^i amounts to announcing the forecast Pr⁡(Sr(i)∣Si=xi)\Pr(S^{r(i)}\mid S^i = x^i). The true forecast is the one conditioned on s∗s^*. The log rule is strictly proper, and different signals induce different forecasts (signals are informative), so (27.3) is uniquely maximized at xi=s∗x^i = s^*.

∎

ExampleThe numbers: honesty wins

Rater ii saw ll.

ReportExpected score
honest ll0.54ln⁡0.54+0.46ln⁡0.46≈−0.690.54\ln0.54 + 0.46\ln0.46 \approx -0.69
lie hh0.54ln⁡0.71+0.46ln⁡0.29≈−0.750.54\ln0.71 + 0.46\ln0.29 \approx -0.75

The expectations use ii‘s true beliefs (0.540.54, 0.460.46). The log terms use the forecast implied by her report.

ImportantWhy peer prediction beats agreement

The score depends on the updated belief about the peer’s signal given your report, not on whether you match. The update already folds in the prior, so there’s no reason to shade your report toward the prior’s likely outcome. The rater just reports what she saw, trusting the center to do the Bayes.

NoteScores are penalties

Since 0<Pr⁡<10 < \Pr < 1, τi∗<0\tau_i^* < 0. Adding a constant that depends only on ff makes scores positive without changing incentives.

WarningNon-truthful equilibria exist

“Always report hh” is also an equilibrium. Against an always-hh reference rater, reporting ll scores ln⁡0.54≈−0.62\ln0.54\approx-0.62 and reporting hh scores ln⁡0.71≈−0.34\ln0.71\approx-0.34. Similarly for always-ll. Mitigations:

  • the truthful equilibrium is focal (limited communication; some raters prefer honesty);
  • the center can punish everyone on detecting an uninformative pattern.

Extensions.

ModificationEffect
add a constantraises payoffs; incentives unchanged
multiply by a constantincentives unchanged, but tunes how much costly effort raters spend acquiring signals
settle via transfers between ratersbudget-balanced, no subsidy from the center
alternative proper rulessmaller expected payments (Jurca–Faltings)
sequential reportingscore each rater on the belief implied by the prior, previous reports and her own; reporting her own signal stays optimal

CautionThe weak point: common priors

The center needs common beliefs about types and about signal distributions given types, to infer each forecast. Eliciting the forecast directly fails, because ii‘s signal report is also needed to score someone else.

  • Partial fix 1: ask each rater for her personal prior over types before she observes, then her signal.
  • Partial fix 2: define types empirically by their signal distributions (type 1 gives 10% hh, type 2 gives 20%, …), which makes the conditional signal beliefs common by construction.

NoteOpen questions

Raters of differing ability, where scores both assess credibility and give incentives; self-selected rather than random interaction partners; robustness to collusion and sybil confirmers.


Transitive trust and sybils

DefinitionTransitive trust

Postulate: a rater’s credibility equals her reputation as an actor. Weight ratings of an entity by the raters’ credibilities, which come from their reputations. This is recursive: bootstrap from a credible set and grow it along positive feedback. Positive feedback from a well-rated eBay member counts more.

DefinitionTrust graph and reputation function

Ignore time order. The trust graph is G=(V,E,t)G = (V, E, t), where t(ij)>0t(ij) > 0 summarizes ii‘s trust in jj. Graphs are sparse, so EE is listed explicitly. A reputation function F:G→R∣V∣F : G \to \mathbb{R}^{|V|} induces a ranking of the nodes. FF is trivial if the ranking is the same for every GG.

Reputation functionDefinitionSeeded?
PageRank (simple)Fv=ϵ+(1−ϵ)∑(v′,v)∈EFv′ t(v′,v)F_v = \epsilon + (1-\epsilon)\sum_{(v',v)\in E}F_{v'}\,t(v',v); web: t(v,w)=1/Out(v)t(v,w) = 1/\mathrm{Out}(v)no (symmetric)
max-flow (Advogato)FvF_v = max flow from seed v0v_0 to vv, with capacities ttyes
Pathrankranked by shortest path from v0v_0 to vv, edge length 1/t1/t (shorter = better)yes

In P2P settings each node can use itself as the seed (personalized reputation). For web ranking, pick trusted seeds.

DefinitionMonotonic and symmetric

  • Monotonic: adding an incoming edge uvuv never lowers vv‘s rank relative to any ww (both strict and weak order preserved). All three functions above are monotonic (PageRank: Chien et al.).
  • Symmetric: FF commutes with relabelling nodes; reputations depend only on graph structure. PageRank is symmetric. Max-flow and Pathrank are not: the seed is privileged.

Honest reporting: rank-strategyproofness

WarningTransitive trust has the worst incentives

Raters are rewarded only for ratings they receive, never for ratings they give. So there is no incentive to rate informatively, and possibly an incentive to rate strategically, to undermine rivals’ credibility.

DefinitionRank-strategyproof

No agent vv, in any graph, can improve her position in the ranking by changing how she rates others. (Changing scores is allowed; improving rank is not.)

TheoremImpossibility for symmetric systems

No nontrivial, monotonic, symmetric reputation system is rank-strategyproof.

ExamplePageRank manipulation

Node vv can drop an outgoing edge to a higher-ranked node uu. That lowers uu‘s score, which can move vv above uu.

NoteCited, not proved

See Altman–Tennenholtz and related axiomatic work (compare the axiomatic method in cost-sharing). Pathrank escapes: it is monotonic and rank-strategyproof.

Sybil attacks

DefinitionDefinition 27.2 — sybil strategy

Given GG and user vv, a sybil strategy is a graph G′G' and a set U′∋vU'\ni v of sybils such that collapsing U′U' into one node labelled vv gives back GG. The attacker may create any number of sybils with any trust among them, split incoming trust among them in any way that preserves the total ∑v′t(v′,v)\sum_{v'}t(v',v), and set outgoing edges arbitrarily.

DefinitionDefinitions 27.3–27.4 — sybilproofness

  • Value-sybilproof: no sybil strategy gives any u∈U′u\in U' a score Fu(G′)>Fv(G)F_u(G') > F_v(G). You can’t raise your number.
  • Rank-sybilproof: no sybil strategy gives some u∈U′u\in U' a score Fu(G′)≥Fw(G′)F_u(G')\ge F_w(G') for some w∈V∖{v}w\in V\setminus\{v\} with Fv(G)<Fw(G)F_v(G) < F_w(G). You can’t overtake anyone.

TheoremTheorem 27.5 — no symmetric rank-sybilproof function

No nontrivial symmetric reputation function is rank-sybilproof. Monotonicity is not assumed.

ProofClone the whole network

Step 1: Pick a target. Nontriviality gives a graph GG with Fw(G)>Fv(G)F_w(G) > F_v(G).

Step 2: Sybil strategy. Let G′G' be two disjoint copies of GG, and let the sybils U′U' be vv together with the whole second copy. Collapsing U′U' into vv returns GG (up to internal edges).

The key step: by symmetry, swapping the two copies is an automorphism, so the copy uu of ww has Fu(G′)=Fw(G′)F_u(G') = F_w(G'). A sybil now ties ww, whom vv previously trailed. Rank-sybilproofness fails.

∎

graph LR
  subgraph Original["Original graph G"]
    V1["v: lower rank"] --- W1["w: higher rank"]
  end
  subgraph Clone["Sybil copy of G, all controlled by v"]
    V2["copy of v"] --- W2["copy of w: ties w by symmetry"]
  end

DefinitionDefinition 27.6 — KK-rank-sybilproof

Rank-sybilproof against all sybil strategies with ∣U′∣≤K+1|U'|\le K+1.

TheoremTheorem 27.7 — even one sybil breaks symmetry

No nontrivial symmetric reputation function is KK-rank-sybilproof for any K>0K > 0.

ProofAdd the clone one node at a time

Step 1: Interpolate. With V={v=v1,…,vr=w}V = \{v = v_1, \dots, v_r = w\} and clone {u1,…,ur}\{u_1,\dots,u_r\}, let GtG^t contain V∪{u1,…,ut}V\cup\{u_1,\dots,u_t\}. So G0=GG^0 = G and Gr=G′G^r = G'.

Step 2: A first crossing. At t=0t = 0, the best of vv‘s identities trails ww. At t=rt = r, uru_r ties ww (Theorem 27.5). So some tt has max⁡i∈{v,u1..ut}Fi(Gt)<Fw(Gt)\max_{i\in\{v,u_1..u_t\}}F_i(G^t) < F_w(G^t) but max⁡i∈{v,u1..ut+1}Fi(Gt+1)≥Fw(Gt+1)\max_{i\in\{v,u_1..u_{t+1}\}}F_i(G^{t+1}) \ge F_w(G^{t+1}).

The key step: let mm be the top identity in Gt+1G^{t+1}. Either mm or ut+1u_{t+1} now reaches ww. So adding the single node ut+1u_{t+1} is a successful 1-sybil strategy for mm in GtG^t.

∎

WarningPageRank

PageRank is symmetric, so it is not rank-sybilproof. About half of all web pages could double their PageRank with a single sybil.

Escape: break symmetry with a trusted seed. Seeding alone isn’t enough; the aggregation rule matters too.

TheoremTheorem 27.8 — max-flow is value-sybilproof

The max-flow ranking from a seed ss is value-sybilproof.

ProofMin cut bounds every sybil

By max-flow = min-cut, Fv(G)F_v(G) is the capacity of a minimum ss–vv cut. All of vv‘s sybils lie on vv‘s side of that cut, away from ss. The trust entering them is at most the trust entering vv, so no sybil’s max flow exceeds Fv(G)F_v(G).

∎

ExampleFigure 27.2 — max-flow is not rank-sybilproof

Node aa lies on a max-flow path to a node bb ranked above it. aa reroutes its outgoing trust from bb into a sybil a′a'. aa’s own value is unchanged, but bb loses the flow through aa and falls below aa. The attacker can’t raise itself, but it can lower others that depend on it.

TheoremTheorem 27.9 — Pathrank is value- and rank-sybilproof

Shortest-path ranking from a seed is both value-sybilproof and rank-sybilproof.

ProofSybils can’t shorten paths, and blockers are already ahead

Value: sybils sit behind vv, so no path to a sybil is shorter than the shortest path to vv.

Rank: vv can affect ww‘s value only if vv lies on the shortest ss–ww path. But then vv is strictly closer to ss than ww, so vv already outranks ww. There is no one it could overtake by manipulating.

∎

ImportantFlows vs paths

The pattern generalizes. Generalized flow mechanisms (e.g., “leaky pipes”) are value- but not rank-sybilproof. Generalized path mechanisms are both, and in a large class, only path-based mechanisms are rank-sybilproof.

NoteOpen question

PageRank and max-flow are not worst-case sybilproof but are very useful in practice. Are they less manipulable on average? This needs a precise formulation.


Open problems and extensions

NoteDistributed reputation systems

In P2P and ad hoc networks there is no trusted party computing reputations, and users may intercept or alter messages. Techniques: replication (compute at many nodes and detect inconsistencies), and redundant paths so no single user can block or modify messages. Both are vulnerable to collusion. The defense is to require many colluders, which sybils undermine.

NoteDynamic attacks

Users may claim credit for others’ interactions, or copy others’ actions (puzzle solutions, ratings) to build reputation cheaply. Conversely, dynamics can limit attacks: in P2P, sybils need real interactions to gain incoming links, and low-ranked sybils struggle to find partners.

NoteMetrics and benchmarks

Robustness isn’t everything. Giving everyone zero reputation is perfectly secure and perfectly useless. We need metrics (economic welfare, or more direct measures) of how well an aggregation method serves users’ information needs.

NoteOther disciplines, and synthesis

Sociology and social psychology study the broader notion of trust. The grand challenge is a single design combining honest elicitation, whitewashing and sybil robustness, and distributed computation.


Quick reference

ObjectStatementNote
Benefits of visible historyability revelation; deters moral hazard; averts adverse selection
Three threatswhitewashing; incorrect feedback; phantom (sybil) feedbackcheap pseudonyms
PD payoffsCC=1CC = 1, DD=0DD = 0, DC=2DC = 2, CD=−1CD = -1
Discounted averageπi=(1−δ)∑δtπit\pi_i = (1-\delta)\sum\delta^t\pi_i^t
Grim SPNEiff δ≥1/2\delta\ge1/22(1−δ)≤12(1-\delta)\le1
Reputational GrimSPNE for δ≥1/2\delta\ge1/2 under random matchingshared history
Personalized Grimneeds δ≥1−1/(2N)\delta\ge1 - 1/(2N)private histories don’t scale
Entry feedeters whitewashing iff f≥1/δf\ge1/\delta
PYDveterans exploit newcomers once; newcomers cooperate(D,C)(D,C) total 1 vs 2
Noisy dynamic modelPYD maximizes cooperationFriedman–Resnick
Fix for newcomer distrustmake new pseudonyms costly for existing membersone free pseudonym
Signal modelcommon prior Pr⁡0(t)\Pr_0(t); i.i.d. signals f(s∣t)f(s\mid t); ∣I∣≥3\lvert I\rvert\ge3center has no outside info
Herdingagreement rewards suppress minority signalsEx.: Pr⁡(h∣l)≈0.54\Pr(h\mid l)\approx0.54
Strictly proper ruletruth uniquely maximizes expected scorelog rule
Peer prediction (27.2)τi∗=ln⁡Pr⁡(Sr(i)=xr(i)∣Si=xi)\tau_i^* = \ln\Pr(S^{r(i)} = x^{r(i)}\mid S^i = x^i)the rater reports only her signal
Prop 1truthful is a strict NE for any r(i)≠ir(i)\ne i
Examplehonest ll: −0.69-0.69; lie hh: −0.75-0.75
Non-truthful equilibriaalways-hh, always-llfocal truth; punish uninformative patterns
Weak pointcommon priors on types and signal distributionsempirical types
Trust graphG=(V,E,t)G = (V,E,t), F:G→R∣V∣F: G\to\mathbb R^{\lvert V\rvert}
PageRankFv=ϵ+(1−ϵ)∑Fv′t(v′,v)F_v = \epsilon + (1-\epsilon)\sum F_{v'}t(v',v)symmetric
Max-flow / Pathrankflow / shortest path from seed v0v_0asymmetric
Rank-strategyproofcan’t improve rank by how you rateimpossible if symmetric, monotonic, nontrivial
Sybil strategy (Def 27.2)(G′,U′)(G',U') collapsing to GGsplit incoming trust arbitrarily
Value- / rank-sybilproofcan’t raise own score / can’t overtake anyone
Thm 27.5no symmetric rank-sybilproof FFclone the network
Thm 27.7not even 1-rank-sybilproofadd the clone node by node
Thm 27.8max-flow value-sybilproofmin cut; not rank (Fig. 27.2)
Thm 27.9Pathrank value- and rank-sybilproofonly path-based is rank-sybilproof

Facts to keep to hand

  • Every remedy trades something away. Pay-your-dues buys whitewashing resistance at the cost of newcomer welfare. Peer prediction buys honesty at the cost of a common-prior assumption and spurious equilibria. Seeded path rankings buy sybilproofness at the cost of symmetry and dependence on a trusted seed.
  • Anyone indistinguishable from a deviator must be punished like one. Newcomers look like whitewashers, so they pay dues. This echoes the whitewasher problem in p2p-incentives: generosity toward newcomers subsidizes cheaters.
  • Shared history is what makes reputation scale. Private punishment needs δ→1\delta\to1 as NN grows. Public reputations keep the threshold at 1/21/2.
  • Score beliefs, not agreement. Peer prediction scores the implied forecast of a peer’s signal with a strictly proper rule, which already corrects for the prior, so honest minority reports aren’t penalized. This is the same proper-scoring-rule logic as market scoring rules in prediction-markets.
  • Symmetry is fatal for sybil resistance. If FF ignores labels, cloning the network (or even adding one well-chosen node) lets an attacker tie anyone. Robust systems must privilege a seed.
  • Flows can be drained; paths can’t be shortened. Sybils can’t raise their own flow (min cut) but can starve downstream rivals. On shortest paths, anyone able to influence you is already ahead of you, so rank manipulation is impossible.
  • Security is not the objective. A system that rates everyone zero is unmanipulable and useless. Robustness results must be paired with measures of informativeness.

References

← All notes