Cascading Behavior In Networks
Diffusion of innovations as network contagion; networked coordination games (Morris) and the threshold rule d_B >= q d; contagion threshold, progressive vs nonprogressive dynamics and their equivalence (Theorem 24.1); no graph has contagion threshold above 1/2 via a decreasing cut-size potential (Theorem 24.2); Linear Threshold, General Threshold and Cascade models, and the translation between threshold functions g_v and incremental functions p_v; k-threshold (critical mass) vs diminishing returns vs Independent Cascade; time-layered reduction from nonprogressive to progressive; influence maximization (Domingos–Richardson), NP-hardness and n^(1-eps) inapproximability; submodularity and the Nemhauser–Wolsey–Fisher (1 - 1/e) greedy guarantee; diminishing returns implies submodular influence (Kempe–Kleinberg–Tardos, Theorem 24.4); live-edge proof for Independent Cascade (Theorem 24.5); Mossel–Roch (Theorem 24.6); recommendation incentives; LiveJournal community joining P(k), logarithmic diminishing returns, and the effect of friend connectedness
Motivation: ideas that spread like epidemics
Religions and political movements, agricultural and medical innovations, product hits, celebrities, financial bubbles: all share a pattern. They start with a few early adopters, spread as people see friends adopting, and may sweep the population contagiously, with the dynamics of an epidemic.
Diffusion of innovations became a sociological field in the mid-20th century. It was first empirical (Coleman, Rogers). In the 1970s, Schelling and Granovetter introduced mathematical models. Models matter for three reasons:
- to understand how spreading works;
- to predict success or failure early;
- to shape the process, increasing (or reducing) the chance of success.
IntuitionThe central questions
When each person adopts a behaviour based on what their neighbours do, when can a small seed convert a whole population? And if you can pick people to seed, whom should you pick to maximize the eventual spread — and can that choice be computed?
The running scenario: an old behaviour and a new behaviour competing on a social network. The applications are viral marketing and online communities (LiveJournal).
Networked coordination games
Why coordination? The benefit of a new behaviour often grows with how many of your contacts use it: compatible technologies, shared practices, similar opinions. Self-interest then says adopt once enough neighbours have.
DefinitionNetworked coordination game (Morris 2000; after Blume, Ellison, Young)
is a social network: nodes are individuals, edges are social ties. Each node chooses (old) or (new). On each edge , with parameter :
| : | : | |
|---|---|---|
| : | ||
| : |
A node’s payoff is the sum over its edges.
FormulaThe threshold rule
With degree and neighbours on and : choosing earns , choosing earns . Hence (ties go to ).
Intuition is a threshold
A node switches once a fraction of its neighbours have. Small means is locally much better and spreads easily. Large means needs overwhelming local support.
RemarkIt’s a potential game
Pairwise coordination games summed over edges form a potential game, as in network-formation-games. The chapter doesn’t use this; the remark is mine.
Contagion and the contagion threshold
Dynamics. Every node updates simultaneously at , best-responding to its neighbours’ current behaviour. If is the initial set of -adopters:
- is the set of -adopters after one round;
- is the set after rounds.
This is nonprogressive: nodes may switch back, so in general.
DefinitionConverted, contagious, contagion threshold
Take countably infinite with finite degrees.
- is converted by if for all some .
- is contagious if it converts every node.
- The contagion threshold of is the maximum for which a finite contagious set exists.
It is a property of the topology alone. A high contagion threshold means even sluggish behaviours can take over.
ExampleThe infinite path at
Nodes .
- Seed : at , nodes adopt , but node sees two neighbours and reverts. At , nodes revert. dies out.
- Seed : it holds, and adopt. At step , nodes hold and adopt. Contagious. (The seed already suffices.)
- : never passes the rightmost seed.
So the path’s contagion threshold is exactly .
graph LR A2["-2: A"] --- A1["-1: B"] A1 --- Z["0: B"] Z --- P1["1: B"] P1 --- P2["2: A, next to switch"]
Many simple graphs have threshold , and none seems to exceed it. Is there a graph with contagion threshold above ?
Progressive vs nonprogressive
DefinitionProgressive dynamics
Once a node adopts , it never reverts (like going back to graduate school). One step is with , “converted” and “contagious” defined as before.
Intuitively, progressive spread should be easier, because early adopters can’t defect and kill the cascade. Surprisingly, it isn’t:
TheoremTheorem 24.1 — same contagion threshold (Morris)
For any graph , a finite contagious set exists for iff one exists for .
ProofRun the progressive process until it engulfs the seed’s neighbourhood
Easy direction. A set contagious under is contagious under , since progressive dynamics only keep more nodes on .
Step 1: Enlarge the seed. Let be contagious under , and let , which is finite because degrees are finite. Since eventually covers everything, some has . Set .
Step 2: A useful identity (left as an exercise; induction on ): Every node that joined after the start did so with at least a fraction of its neighbours already in, and those neighbours are still in.
Step 3: The "" becomes redundant. Write . For , . But , so every node of has all neighbours on and is in . Hence .
The key step: by induction, for all . So is contagious under the nonprogressive rule. Once the seed is surrounded, nobody in it ever wants to revert.
∎
No graph beats 1/2
TheoremTheorem 24.2 — contagion threshold ≤ 1/2 (Morris)
Every graph has contagion threshold at most . A behaviour that needs a strict majority of your friends cannot spread from a finite seed.
ProofThe cut size is a strictly decreasing potential
By Theorem 24.1 it suffices to consider the progressive process. Fix and a finite , and let . For a set , let be the number of edges leaving . This is a natural number for finite .
Step 1: Each growth step shrinks the cut. Suppose and . Then ‘s edges into leave the cut, and its edges into join it. Edges between two new nodes are in neither cut. Since switched with , Summing over new nodes, .
Step 2: A natural number can’t decrease forever. So the sets stop growing at some finite . The graph is infinite, so is not contagious.
∎
IntuitionWhy majority rule traps cascades
Each new adopter brings more boundary edges in than it pushes out. So the frontier between and keeps shrinking until it can’t move. Majority-requiring behaviours stay stuck in pockets.
General models of social contagion
The first model has one threshold for everyone and equal weight on every neighbour. Real populations are heterogeneous. From here on:
- graphs may be finite or infinite, and are directed (influence need not be symmetric; is a neighbour of if );
- processes are progressive, with a reduction for the nonprogressive case at the end;
- a node on is active, and switching to is being activated.
DefinitionLinear Threshold Model
- Weights on edges , with .
- Each node draws a threshold .
- Inactive activates when
A small means an eager adopter. The model can be derived from a coordination game with heterogeneous payoffs and stakes.
DefinitionGeneral Threshold Model
Each has a monotone set function () and a threshold . activates when its active neighbour set satisfies .
This expresses non-additive rules such as “two relatives and three coworkers.” A uniform threshold is WLOG, since other distributions can be folded into .
NoteNonmonotone influence
Adopting after a few friends do but abandoning once too many do has been discussed qualitatively (Granovetter) but is little modelled.
DefinitionCascade Model
When becomes active, it gets one chance to activate each inactive out-neighbour . It succeeds with probability , where is the set of ‘s neighbours that have already tried and failed. The incremental functions are assumed order-independent: the overall success probability doesn’t depend on the order in which neighbours try.
TheoremThreshold ⟺ Cascade (Kempe–Kleinberg–Tardos)
The General Threshold and Cascade models are equivalent: each translates into the other with the same distribution over outcomes.
DerivationThe two translations
Threshold → Cascade. If has tried and failed, then , uniformly. succeeds iff :
Cascade → Threshold. survives attempts by with probability , where . Order-independence makes this well-defined, so
Three special cases
| Case | Incremental function | Character |
|---|---|---|
| (i) -threshold | if , else | critical mass: nothing until the -th exposure |
| (ii) diminishing returns | whenever | each extra exposure is worth less |
| (iii) Independent Cascade | a special case of (ii) |
ImportantThe central dichotomy
Critical mass (i) versus diminishing returns (ii). This local distinction decides the complexity of influence maximization (Finding influential sets of nodes), and it is what the empirical data try to detect (Empirical evidence from online communities).
Nonprogressive via progressive (Kempe et al.)
AlgorithmTime-layered reduction
For a nonprogressive process on over steps, build from copies . Add an edge for each neighbour of , where is ‘s copy in layer . Use the same influence rules node by node.
A progressive process on then records exactly which time steps each was active in . The construction works for any influence rule.
graph LR U1["u in layer 1"] --> V2["v in layer 2"] W1["w in layer 1"] --> V2 U2["u in layer 2"] --> V3["v in layer 3"] W2["w in layer 2"] --> V3
Finding influential sets of nodes
Applications.
- Viral marketing: use word of mouth to stretch a limited advertising budget. It is especially powerful online, with easy sharing and rich customer data.
- News and blog tracking: stories spread in waves through mainstream outlets and blogs, and online data lets tools follow them in real time.
DefinitionInfluence maximization (Domingos–Richardson)
Given a finite instance of the General Threshold or Cascade model, let be the expected number of active nodes at the end when is seeded. For a budget : To a marketer, is the expected sales from seeding .
| Component | Detail |
|---|---|
| Signature | |
| Domain | a seed set of initial adopters |
| Codomain | expected final cascade size |
| Property | monotone, with |
NoteInferring the network
How one obtains the social network and the cascade model is “an interesting and largely unexplored topic.” Here they are given.
CautionHard in general
For nearly every special case, finding the optimal is NP-hard. Some instances are NP-hard to approximate within for any (Kempe et al. 2003). Both proofs are left as exercises. The hard instances have a knife-edge : almost no spread until exactly the right set is seeded, then a sudden large cascade.
Submodularity and greedy seeding
DefinitionSubmodular set function
is submodular if for all and : It expresses diminishing returns at the level of seed sets.
TheoremTheorem 24.3 — greedy is -optimal (Nemhauser–Wolsey–Fisher)
Let be monotone submodular and an optimal -set. If is built by adding, times, the element with the largest marginal gain, then
NoteStated without proof
The chapter cites this classical result.
IntuitionWhy greedy works
With diminishing returns, a big optimum can’t hide. If the optimum is much better than your current set, then some single element must offer a large marginal gain right now, and greedy takes it.
RemarkApproximate evaluation
Evaluating exactly is itself intractable. But sufficiently accurate estimates (the values are integers) give , and such estimates are achievable for these models.
WarningCritical mass breaks submodularity
If every node has a sharp threshold (it needs active neighbours), can stay tiny until enough seeds are chosen and then jump. That is not submodular. Node-level critical mass tends to produce exactly the knife-edge functions behind inapproximability.
Local diminishing returns implies global submodularity
TheoremTheorem 24.4 — Kempe–Kleinberg–Tardos
In any Cascade Model instance in which every has diminishing returns, the influence function is submodular. So greedy seeding is -optimal.
ImportantLocal-to-global
If each individual responds to influence with diminishing returns, the network as a whole responds to an outside marketer with diminishing returns. Finding such local-to-global principles is a recurring theme in social network research.
The general proof is intricate. The special case is clean:
TheoremTheorem 24.5 — Independent Cascade is submodular
In any Independent Cascade instance, is submodular.
ProofLive-edge decomposition into size-of-union functions
Step 1: Two facts about submodularity.
- A nonnegative combination of submodular functions is submodular.
- A size-of-union function is submodular: adding gains , which can only shrink as grows.
Step 2: Flip all coins in advance. Instead of flipping ‘s coin for edge when activates, flip a -coin for every edge up front and consult it only if needed. This gives the same distribution. Let range over the outcomes. Edges whose coin came up heads are live.
Step 3: Fixed coins give reachability. With outcome , a node ends up active iff it is reachable from by live edges. With the set of nodes live-reachable from , a size-of-union function, hence submodular.
The key step: is a nonnegative combination of submodular functions, so it is submodular. The trick is to decompose an intractable into tractable pieces rather than attack it directly.
∎
How far does it generalize?
- Diminishing-returns translate into submodular . The converse fails: some submodular translate into without diminishing returns.
- The Linear Threshold Model is such a case. It is not a diminishing-returns cascade, yet its is still submodular, by a separate analysis.
- So “General Threshold with submodular ” is strictly more general, and it too gives submodular influence:
TheoremTheorem 24.6 — Mossel–Roch (2007)
In any General Threshold instance in which every is submodular, is submodular. This proves a conjecture of Kempe et al. and generalizes Theorem 24.4.
NoteProofs omitted
The chapter proves only Theorem 24.5, and cites Theorems 24.4 and 24.6 and the Linear Threshold result.
Another lever: targeting edges
ExampleRecommendation incentives
Rather than seeding nodes, amplify edges. After buying, you can e-mail a friend a special offer, and if they buy, you both get a refund (Leskovec et al.). This strengthens influence transmission across edges, though some initial adopters are still needed.
NoteOpen problem
Theoretical models of recommendation incentives for influence maximization remain open. There is only empirical work.
Empirical evidence from online communities
Classical diffusion studies are rich but small: too small to estimate, for example, how adoption probability depends on the structure of one’s neighbourhood. Large online datasets change this.
DefinitionLiveJournal community joining (Backstrom et al. 2006)
The social network has an edge if lists as a friend. Each community is treated as a diffusing behaviour. Take snapshots at times , a few months apart. Let be the set of pairs with at and having friends in at . is the probability of joining given friends already in.
ExampleFigure 24.1 — what looks like
- Diminishing returns dominate: grows ever more slowly, fitting well up to fairly large . So it keeps increasing even at large .
- A small critical-mass bump: for the curve deviates, with . A second friend gives a disproportionate boost, and then diminishing returns take over.
- The same diminishing-returns shape appears for publishing at a CS conference versus the number of coauthors who already have, and for buying a DVD versus the number of friends’ e-mail recommendations.
NoteOpen question
Why logarithmic diminishing returns, across such different datasets? No mechanism is known.
ExampleConnectedness of friends matters
Among users with friends in a community, joining is more likely when those friends are densely connected to one another. A tightly knit group exerts more “gravitational force” than the same number of scattered friends. Current models don’t capture this. Explaining it, and extending the models, is open.
WarningCaveat 1: more data, less meaning
We know little about who LiveJournal users are, what a “friend” link means (close friend, acquaintance, link collecting), or why they join. Nuanced classical questions are out of reach. But scale is exactly what makes the curve so smooth: hundreds of thousands of communities on millions of users. Given how heterogeneous the links are, the clean logarithm is all the more striking.
WarningCaveat 2: aggregate snapshots vs operational models
The models are operational: each node applies a fixed rule over time. is an aggregate from two snapshots. It says nothing about any individual’s response rule, or about when (or whether) users noticed their friends’ behaviour. So it is unclear how the empirical “diminishing returns” aligns with the formal definitions in §§24.3–24.4. Frameworks that handle this asynchrony and uncertainty are needed.
RemarkA feedback loop
Diffusion is increasingly built into system design (social search, media sharing, community Q&A), producing large, finely time-resolved data that will drive richer theories.
Quick reference
| Object | Statement | Note |
|---|---|---|
| Coordination game | payoffs (), (), (mismatch) | summed over edges |
| Threshold rule | adopt iff | small spreads easily |
| Contagious set | converts every node eventually | countably infinite graph, finite degrees |
| Contagion threshold | max with a finite contagious set | topology only |
| Infinite path | threshold ; seed works | dies out |
| Progressive step | no reverting | |
| Thm 24.1 | finite contagious set: progressive ⟺ nonprogressive | engulf the seed’s neighbourhood |
| Identity (24.1) | exercise | |
| Thm 24.2 | contagion threshold | cut size strictly decreases |
| Linear Threshold | activate if , | |
| General Threshold | activate if | monotone |
| Cascade Model | one attempt; success | order-independent |
| Threshold → Cascade | ||
| Cascade → Threshold | ||
| -threshold | iff | critical mass |
| Diminishing returns | for | |
| Independent Cascade | ||
| Time-layered graph | copies; edges | nonprogressive → progressive |
| Influence max | NP-hard; -inapproximable in general | |
| Submodularity | marginal gains shrink as the set grows | |
| Thm 24.3 | greedy OPT | monotone submodular |
| Thm 24.4 | diminishing-returns ⇒ submodular | local → global |
| Thm 24.5 | Independent Cascade ⇒ submodular | live edges; size-of-union |
| Linear Threshold | submodular (separate proof) | not a DR cascade |
| Thm 24.6 | submodular ⇒ submodular | Mossel–Roch |
| Recommendation incentives | target edges, not nodes | theory open |
| LiveJournal | ; | diminishing returns plus a small critical-mass bump |
| Friend connectedness | denser friend sets raise joining | unmodelled |
Facts to keep to hand
- Critical mass versus diminishing returns is the axis of the chapter. It separates the -hard knife-edge instances from the -approximable ones. It is also the question the LiveJournal data answer: mostly diminishing returns, with a small critical-mass bump at .
- Local rules decide global properties. Majority thresholds cap contagion at . Diminishing returns at every node give submodular influence for the whole network. Both results turn a per-node condition into a network-wide guarantee.
- Potential arguments again. Theorem 24.2 is a potential-function proof: the cut size strictly decreases, just like the potentials in network-formation-games and the routing chapter.
- Decompose the intractable into the tractable. can’t be evaluated exactly, but fixing randomness in advance (live edges) writes it as an average of reachability functions, each obviously submodular.
- Submodularity recurs across these notes. Submodular games make Shapley shares cross-monotone (cost-sharing). Submodular welfare gives utility games PoA 2 (network-formation-games). Submodular influence makes greedy seeding -optimal. In each case diminishing returns is what makes local or greedy reasoning safe.
- Surround the seed. Theorem 24.1’s trick: once the adopters include every neighbour of the original seed, no one inside has a reason to revert, so nonprogressive spread behaves like progressive spread.
- Scale buys smoothness, not meaning. Online data give clean aggregate curves at the cost of knowing what links mean or when decisions happen. Connecting snapshot aggregates to operational node rules is open.
References
- Nisan, Roughgarden, Tardos, Vazirani, Algorithmic Game Theory — chapter 24 (Kleinberg)