Skip to content
~vaibhav
Topics / Algorithms

Algorithms

[you@here ~]$ grep -rl "algorithms" *.md

Subtopics

  • Bandits 20

Documents

  • Bandit Algorithms My annotations of the book "Bandit Algorithms" (Lattimore & Szepesvári). 19 notes in reading order Open ↗

Notes

  • Adversarial Linear Bandits 10/5/2026
  • Bayesian Bandits 10/5/2026
  • Combinatorial Bandits 10/5/2026
  • Concentration of Measure for Bandits 10/5/2026
  • Confidence Bounds and Optimal Design for Least Squares Estimators 10/5/2026
  • Contextual Bandits 10/5/2026
  • Convex Analysis for Bandits 10/5/2026
  • The Exp3 and Exp3-IX Algorithms 10/5/2026
  • Explore-Then-Commit and the Upper Confidence Bound Algorithms 10/5/2026
  • Lower Bounds for Finite-Armed Bandits 10/5/2026
  • Lower Bounds for Stochastic Linear Bandits 10/5/2026
  • Markov Decision Processes — From Bandits to Reinforcement Learning 10/5/2026
  • Non-Stationary Bandits 10/5/2026
  • Partial Monitoring 10/5/2026
  • Pure Exploration and Best-Arm Identification 10/5/2026
  • Ranking Bandits 10/5/2026
  • Stochastic Processes, Markov Chains, and Stochastic Bandits 10/5/2026
  • Stochastic Linear Bandits 10/5/2026
  • Thompson Sampling 10/5/2026

← all topics

RSS GitHub Email Colophon

Built 2026-10-26.