Every claim on this page comes from the lab's sourced research notes (checked 2026-10-05).
Purpose. Sourced notes for a Research Lab learning page: classical statistics and machine-learning methods built on Wasserstein spaces / optimal transport (OT), for operations research, risk, and business planning (forecasting, budgeting, capacity, inventory, credit/market risk, scenario planning, challenger models).
House rules followed.
-
No neural networks or large pretrained models in the core toolkit. Neural mentions are labelled
EXCEPTION(two, both minor and excluded; see §13). -
Papers from 2020+ preferred; older work is tagged
background. -
Every paper below was checked against arXiv (API metadata + abstract), Crossref/DOI, or the publisher/CRAN page on 2026-10-05. Summaries come from the abstract or full text actually read. Anything not verified is tagged
UNVERIFIEDor listed in §16. -
Works are cited by title, venue, year, link only — no researcher names, no personal framing.
notes/kernel_ot_learning.html) covers Markov kernels valued in Wasserstein spaces — maps whose output space carries the Wasserstein metric. Every method here can be read through that lens: a probabilistic forecaster is a Markov kernel from information to predictive distributions; a scenario generator is a kernel from state to scenario law; Wasserstein DRO asks how an expected cost changes when a kernel's output is perturbed inside a ball; distributional regression (§3) literally estimates a Markov kernel in . Link the two pages both ways.§0. One-screen brief
Why OT matters for planners. Planning and risk work already lives in distributions (demand scenarios, P&L distributions, forecast fans, return densities). OT gives three practical things:
-
A geometry for distributions that respects "how far mass must move" — a forecast off by 5 units is closer than one off by 50, unlike KL or total variation, which saturate once supports stop overlapping.
-
A robustness language (Wasserstein distributionally robust optimization, DRO): optimize against every distribution within distance of the data. For many problems this becomes a convex program — often a regularized version of what you already run.
-
Cheap 1-D closed forms: in one dimension OT is sorting/quantiles. averaging = quantile averaging; distribution regression = regression on quantile functions. Most planning variables are 1-D or low-D.
Basics: Wasserstein DRO and the ambiguity ball
From the brief (§0). A robustness language (Wasserstein distributionally robust optimization, DRO): optimize against every distribution within distance of the data. For many problems this becomes a convex program — often a regularized version of what you already run.
Wasserstein distance (§0.5). For on a metric space with finite -th moments,
where is the set of couplings (joint laws with marginals ).
Duality (, Kantorovich–Rubinstein). — the reason Wasserstein DRO behaves like Lipschitz regularization.
Glossary (§14).
- DRO — distributionally robust optimization: optimize against the worst distribution in an ambiguity set.
- Ambiguity set / ball radius — set of plausible distributions; radius sets conservatism.
- Type-1 / type-2 WDRO — ambiguity balls using (Lipschitz-like regularization) or (variance-like regularization).
- Certificate — the worst-case objective value; an upper bound that holds with stated confidence when the radius is calibrated.
Basics: quantile functions and 1-D
From the brief (§0). Cheap 1-D closed forms: in one dimension OT is sorting/quantiles. averaging = quantile averaging; distribution regression = regression on quantile functions. Most planning variables are 1-D or low-D.
One dimension (§0.5). With quantile functions :
Glossary (§14). Quantile function — inverse CDF; in 1-D, = distance between quantile functions.
Nine families (rating = potential for OR/risk/planning):
| # | Family | Rating |
|---|---|---|
| 1 | Wasserstein DRO for decisions (inventory, capacity, unit commitment, chance constraints) | High |
| 2 | Mean–covariance (Gelbrich) robust risk and portfolios | High (standout) |
| 3 | Distributional regression and density time series in Wasserstein space | High |
| 4 | Barycenters, forecast combination, scenario generation/reduction | High |
| 5 | OT for causal inference and policy evaluation | Medium–High |
| 6 | Multivariate quantiles, OT ranks, OT conformal, multivariate VaR regions | Medium (conformal: speculative-but-promising) |
| 7 | Drift, change-point and regime detection | Medium–High |
| 8 | Robust risk measures, stress testing, martingale OT, adapted Wasserstein | Medium–High (pricing: Medium) |
| 9 | Matching/assignment, demand inversion, Gromov–Wasserstein, forecast reconciliation | Medium / Speculative |
§10 covers the tools and statistical rates underneath everything; §11.5 is the Small-N toolkit (N<100); §11 is a computed worked example (including N=10/30); §12 ranks five project ideas.
§0.5 Core objects (used throughout)
Wasserstein distance. For on a metric space with finite -th moments,
where is the set of couplings (joint laws with marginals ).
One dimension (the planner's workhorse). With quantile functions :
Duality (, Kantorovich–Rubinstein). — the reason Wasserstein DRO behaves like Lipschitz regularization.
Entropic OT / Sinkhorn background. Add to the transport cost; solve by alternating scalings , with . Cost per iteration versus for exact OT. Reference text: Computational Optimal Transport — Foundations and Trends in Machine Learning, 2019 — arXiv:1803.00567.
Barycenter. . In 1-D: (average the quantiles).
Gaussian / Gelbrich formula. . For non-Gaussian laws with these moments, the right side (the Gelbrich distance) is a lower bound on .
Basics: barycenter
Core object (§0.5).
In 1-D: (average the quantiles).
Glossary (§14).
- Barycenter — Fréchet mean of distributions under ; in 1-D, average quantiles.
- Linear pool — mixture of forecast densities (averaging probabilities, not quantiles).
§1. Wasserstein DRO for decisions High
Core idea. You have observations of an uncertain quantity (demand, renewable output, returns). Sample average approximation (SAA) optimizes against the empirical law and overfits when is small. Wasserstein DRO hedges against every law within -distance :
Basics: SAA (sample average approximation)
Glossary (§14). SAA — sample average approximation: optimize against the empirical distribution.
Key dual (type-1, strong duality).
For piecewise-linear losses and polyhedral support this is a linear program (background paper below). If is -Lipschitz and the adversary has room to move mass, the worst case is — the decision does not change, only the certified cost does (our worked example reproduces this exactly). Type-2 () balls, or binding support bounds, are what actually move decisions.
Regularization view. For linear/logistic models, Wasserstein DRO reproduces norm-regularized estimators (square-root lasso, regularized logistic regression), with the ball radius playing the role of the penalty and giving it a statistical meaning.
Verified papers.
-
backgroundData-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations — Mathematical Programming, 2018 — arXiv:1505.05116. Finite convex (often LP) reformulations + finite-sample guarantees; mean-risk portfolio example. -
backgroundDistributionally robust stochastic optimization with Wasserstein distance — Mathematics of Operations Research (accepted, per arXiv) — arXiv:1604.02199. Strong duality in great generality; structure of worst-case distributions. -
Distributionally Robust Optimization (survey) — Acta Numerica 34 (2025) 579–804 — arXiv:2411.02549, DOI 10.1017/S0962492924000084. The reference to keep open.
-
Finite-sample guarantees for Wasserstein distributionally robust optimization: breaking the curse of dimensionality — arXiv 2020 — arXiv:2009.04382. With a properly chosen radius, WDRO balances empirical loss against the loss's Lipschitz/gradient norm; guarantees free of the curse.
-
Wasserstein distributionally robust optimization and variation regularization — arXiv (v3 2020) — arXiv:1712.06050. General "variation regularization" theory; examples include multi-item newsvendor and portfolio selection.
-
Nash equilibria, regularization and computation in optimal transport-based distributionally robust optimization — arXiv 2023 (v4 2025) — arXiv:2303.03900. Robustification ≈ variation/Lipschitz regularization even for non-metric costs; nature's equilibrium distribution sits on "deceptive adversarial samples".
-
backgroundRegularization via mass transportation — arXiv 2017 — arXiv:1710.10016;backgroundRobust Wasserstein profile inference and applications to machine learning — Journal of Applied Probability, 2019 — arXiv:1610.05627. Regularized regression/classification as WDRO; profile inference picks the radius without cross-validation. -
Confidence regions in Wasserstein distributionally robust estimation — arXiv (v4 2021) — arXiv:1906.01614. Asymptotic normality of DRO estimators; DRO regularizes via the loss derivative.
-
Distributionally robust learning (monograph) — arXiv 2021 — arXiv:2108.08993. DR linear regression, grouped predictors, multi-output, DR regression + nearest-neighbour decisions.
-
Residuals-based distributionally robust optimization with covariate information — arXiv 2020 (v2 2022) — arXiv:2012.01088. Fit any regression, then put a Wasserstein (or other) ambiguity set on the residuals for the decision; size it by cross-validation. The cleanest bridge from a forecast model to a robust plan.
-
Data-driven chance constrained programs over Wasserstein balls — arXiv 2018 (v3 2022) — arXiv:1809.00210. Exact mixed-integer conic (with 1-/∞-norms, MILP) reformulations.
-
On distributionally robust chance constrained programs with Wasserstein distance — arXiv 2018 — arXiv:1806.07418. DR chance constraint ⇔ CVaR-constrained program; big-M and big-M-free formulations.
-
A data-driven distributionally robust newsvendor model with a Wasserstein ambiguity set — Journal of the Operational Research Society 72(8), 2021 — DOI 10.1080/01605682.2020.1746203. Closed-form order and worst-case distribution for order ; CVaR variant.
-
Distributionally robust newsvendor with moment constraints — arXiv 2020 — arXiv:2010.16369. Wasserstein + moment constraints; auto-sales case study.
-
On affine policies for Wasserstein distributionally robust unit commitment — IEEE CDC 2022 (per arXiv) — arXiv:2203.15333. Reformulation whose size does not grow with sample size; 6- and 24-bus tests.
-
Outlier-robust Wasserstein DRO — NeurIPS 2023 — arXiv:2311.05573. Handles geometric perturbation and an -fraction of corrupted data (total-variation contamination).
-
Sinkhorn distributionally robust optimization — arXiv 2021 (v5 2025) — arXiv:2109.11926. Entropic ball; convex dual; stochastic mirror descent.
-
backgroundWasserstein distributionally robust Kalman filtering — NeurIPS 2018 — arXiv:1809.08830. Robust MMSE over a ball of Gaussians; tractable convex program; Frank–Wolfe filter. Code: github.com/sorooshafiee/WKF (MATLAB). Relevant to state-space nowcasting.
Software. POT (pythonot.github.io; POT: Python Optimal Transport — JMLR 22(78), 2021 — jmlr.org/papers/v22/20-451.html); skwdro — scikit-learn-style Wasserstein DRO estimators plus a PyTorch wrapper (skwdro: a library for Wasserstein distributionally robust machine learning — arXiv:2410.21231; PyPI skwdro; docs skwdro.readthedocs.io); CVXPY / Pyomo / python-mip / SciPy-HiGHS for the LP/SOCP reformulations (our example uses SciPy HiGHS).
Data needs. Tens to thousands of roughly i.i.d. observations (or residuals after a forecast model); a sensible ground metric (scale features before using ); known support bounds help.
Failure modes. (i) Radius choice dominates results; cross-validation is noisy at small (seen in our example). (ii) Type-1 with slack support leaves decisions unchanged. (iii) Too large a radius → absurdly conservative decisions (example: order jumps to the support edge). (iv) Serial dependence breaks i.i.d. guarantees. (v) Outliers inflate distances — use the outlier-robust variant.
Potential: HIGH. Mature theory, LP/SOCP reformulations, libraries, and a direct mapping to safety stock, budget contingency, capacity buffers and reserve sizing. Honest caveat: in simple 1-D problems the average out-of-sample gain over SAA is often small (see §11); the main value is a defensible certificate and protection when data are scarce.
Small-N callout (N<100). Radius choice dominates — and cross-validation is actively harmful at N≤30 in our newsvendor Monte Carlo (§11: CV win rate vs SAA = 0.30 at N=10, 0.23 at N=30). Prefer: (i) type-2 balls when the decision must move; (ii) √N variation radii or RWPI/Wasserstein-projection radii instead of concentration balls in d>1; (iii) residuals-based DRO after a simple forecast. Full recipes → §11.5.
§2. Mean–covariance (Gelbrich) robust risk — the standout result High (standout)
Core idea. Practitioners trust means and covariances more than full return distributions. Put a ball in (mean, covariance) space using the Gelbrich distance (= between Gaussians):
Key result (Mean-covariance robust risk measurement — arXiv 2021, v3 2025 — arXiv:2112.09959; full text read). For any law-invariant, translation-invariant, positively homogeneous risk measure (VaR, CVaR, spectral, distortion, mean–std) and a "stable" structural set (all distributions, symmetric, log-concave, Gaussian…), the worst-case risk of portfolio over the Gelbrich ball of radius is in closed form:
-
is a scalar depending only on the risk measure and structure. From the paper: CVaR or VaR at tail level with no structure, ; CVaR under Gaussianity, ; mean–std with aversion , .
-
So robust CVaR/VaR portfolio choice = Markowitz + an explicit penalty whose weight is tied to a statistical radius (a second-order cone program).
-
As the optimum tends to the equal-weight portfolio.
-
With sample mean/covariance of sub-Gaussian returns, gives a confidence ball — a dimension-free rate.
-
The paper gives the worst-case mean and covariance in closed form — ready-made stress scenarios for a given portfolio.
-
Gelbrich risk upper-bounds the corresponding Wasserstein-ball risk, with equality for Gaussian reference laws.
Basics: CVaR
Glossary (§14).
- CVaR — expected loss in the worst fraction of outcomes.
- Distortion risk measure — risk measure computed by reweighting quantiles with a distortion function (VaR, CVaR are special cases).
Basics: SOCP
Not defined in the notes’ primer (§0/§0.5) or glossary (§14). No definition is added here; these are the places the term appears in the notes, quoted:
- §2: “So robust CVaR/VaR portfolio choice = Markowitz + an explicit penalty whose weight is tied to a statistical radius (a second-order cone program).” Software: “NumPy + CVXPY (SOCP).”
- §1: “CVXPY / Pyomo / python-mip / SciPy-HiGHS for the LP/SOCP reformulations (our example uses SciPy HiGHS).”
- §10 table: “Decisions under ambiguity — WDRO LP/SOCP in CVXPY/Pyomo/HiGHS;
skwdro— convex reformulations”; “Mean/covariance only — Gelbrich SOCP — closed form”.
Related verified papers.
-
backgroundDistributionally robust mean-variance portfolio selection with Wasserstein distances — arXiv 2018 — arXiv:1802.04885. DR Markowitz reduces to empirical variance + regularizer; data-driven radius. -
Portfolio optimisation within a Wasserstein ball — arXiv 2020 (v3 2022) — arXiv:2012.04500. Improve on a benchmark's risk profile while staying within a Wasserstein ball of its terminal wealth; isotonic projections.
Software. NumPy + CVXPY (SOCP).
Data needs. Return history long enough for a stable (the paper notes any mean/covariance estimator with error works, e.g. shrinkage).
Failure modes. The penalty is isotropic (ignores factor structure unless you use the paper's Mahalanobis variant); heavy tails weaken sub-Gaussian calibration; very large just gives .
Potential: HIGH. Usable on an ETF panel immediately: allocation, a radius with meaning, and stress scenarios from one formula.
Small-N callout (N<100). This is the standout small-sample portfolio tool: ρ ∼ 1/√N is dimension-free. At N≲20 prefer 1/N or heavy shrinkage (large ρ → equal weight, which is the method's own limit). At N≈30–80 with ≤10–15 assets and a shrinkage covariance, Gelbrich-robust CVaR is the default over empirical Wasserstein balls in asset dimension. Details → §11.5.
§3. Distributional regression and density time series in Wasserstein space High
Core idea. Treat a whole distribution (income distribution, cross-section of returns, intraday load profile, distribution of store sales) as the response — or even the predictor. In 1-D, space is isometric to a convex subset of via the quantile function, so you regress or autoregress quantile functions and project back onto non-decreasing functions.
Formulas.
-
Fréchet regression (global): with linear-regression-type weights . In 1-D the solution is a weighted average of quantile functions, projected to be monotone.
-
Wasserstein autoregression (WAR) on density time series: map to log-maps / tangent vectors around the Fréchet mean , then fit an AR model in that (Hilbert) tangent space, e.g. ; map forecasts back.
-
Distribution-on-distribution via OT maps: with a monotone map — isotonic regression in 1-D.
Verified papers.
-
Fréchet regression for random objects with Euclidean predictors — Annals of Statistics 47(2), 2019 — DOI 10.1214/17-AOS1624, arXiv:1608.03012.
background -
Wasserstein regression — Journal of the American Statistical Association, 2021 — DOI 10.1080/01621459.2021.1956937, arXiv:2006.09660. Distributions as predictors and responses via tangent-space linear models.
-
Wasserstein autoregressive models for density time series — Journal of Time Series Analysis 43(1), 2022 — DOI 10.1111/jtsa.12590, arXiv:2006.12640. Applications include stock-return cross-sections; WAR beats competitors on some but not all datasets — honest mixed evidence.
-
Autoregressive optimal transport models — arXiv 2021 (v4; journal not confirmed) — arXiv:2105.05439. Intrinsic autoregressive models in the space of OT maps: regress transport maps (barycenter→current, or between consecutive distributions) on each other, moving along Wasserstein geodesics.
-
Distribution-on-distribution regression via optimal transport maps — arXiv 2021 (Biometrika per arXiv comment) — arXiv:2104.09418. Regression map estimated by isotonic regression in 1-D.
-
Short-term forecasting with optimal transport — Journal of the Royal Statistical Society Series A 189(2), 2026 — DOI 10.1093/jrsssa/qnaf036. Uses a Sinkhorn-divergence step inside a dynamic factor model with EM for mixed-frequency nowcasting of US GDP — evidence that OT ideas plug into standard nowcasting machinery without neural nets.
Software. R frechet (CRAN; global/local Fréchet regression for distributions); R WRI (CRAN; Wasserstein regression and inference, including WARp for autoregression); Python: NumPy quantile grids + scipy.optimize.isotonic_regression / scikit-learn IsotonicRegression.
Data needs. A panel of distributions: either raw samples per period (≥ ~30 per period to estimate quantiles) or histograms; tens to hundreds of periods for time series.
Failure modes. Only 1-D responses are easy; multivariate responses lose the quantile isometry. Tangent-space linearization breaks for distributions far from the mean. Short histories → overfitting. Quantile crossing must be repaired by projection.
Potential: HIGH. Direct use for forecasting entire distributions of planning variables (store-level demand cross-sections, regional growth, sector return dispersion), and a natural home for nowcasting the shape of the cross-section, not just its mean.
§4. Barycenters, forecast combination, scenario generation and reduction High
Core idea A — consensus forecasts. Linear pooling (averaging densities) inflates dispersion and can create spurious modes. The barycenter averages quantiles: location-scale shape is preserved and the result is unimodal when inputs are. In 1-D:
Entropic regularization of the barycenter widens it — a single knob to undo over-confidence.
Core idea B — scenario reduction. Replace scenarios by weighted ones, minimizing (a -means-like problem for ; -medians for ), or minimizing a problem-driven distance that measures what matters for the decision.
Core idea C — multistage. Scenario trees should be close in the nested distance (OT respecting information flow — see adapted Wasserstein, §8).
Verified papers.
-
Probability forecast combination via entropy regularized Wasserstein distance — Entropy 22(9):929, 2020 — DOI 10.3390/e22090929. Barycenter combination of probability forecasts; in 1-D equals quantile averaging; entropic regularization tunes dispersion; US inflation application.
-
Scenario reduction revisited: fundamental limits and guarantees — Mathematical Programming, 2022 (online 2018) — DOI 10.1007/s10107-018-1269-1, arXiv:1701.04072. Worst-case approximation limits of Wasserstein scenario reduction; MILP and heuristics with guarantees.
-
Optimization-based scenario reduction for data-driven two-stage stochastic optimization — Operations Research 71(4), 2023 — DOI 10.1287/opre.2022.2265. Problem-dependent distance; competitive with only ~1–2% of the original scenarios.
-
Problem-driven scenario clustering in stochastic optimization — arXiv 2021 — arXiv:2106.11717. Cluster scenarios by their effect on decisions, not by raw distance.
-
Entropic regularization of the nested distance — arXiv 2021 — arXiv:2107.09864. Sinkhorn-style computation for multistage scenario-tree distances.
Software. POT (ot.lp.barycenter, ot.bregman.barycenter, ot.emd2_1d); scikit-learn KMeans (as an approximate scenario reducer); Pyomo for the downstream stochastic program.
Data needs. Several probabilistic forecasts as quantiles or samples (combination); a scenario set plus the decision model (reduction).
Failure modes. The barycenter is narrower than the linear pool — if inputs disagree because of genuine uncertainty, that is under-dispersion (our example: P10–P90 width 54 vs 68). In our example the barycenter was closer in to only one of three inputs than the pool was — it is a different compromise, not uniformly "closer". Distance-based reduction ignores which scenarios drive costs (use problem-driven variants).
Potential: HIGH. Cheap, interpretable consensus for challenger-forecast panels; scenario reduction is standard OR practice with OT foundations.
Small-N callout (N<100). Quantile averaging needs no large N — each input can be a thin-history model or a judgmental fan. Scenario reduction from N≈50 scenarios down to m=5–15 (problem-driven) is exactly the scarce-data move for multistage LPs. → §11.5.
§5. OT for causal inference and policy evaluation Medium–High
Core idea. Policy effects on planning metrics are often distributional (a pricing change shifts the tail of order sizes, not just the mean). OT offers: (i) synthetic controls for whole distributions — choose weights so a weighted barycenter of control units' distributions matches the treated unit before treatment; (ii) OT-based matching/balancing weights; (iii) changes-in-changes / nonlinear difference-in-differences via transport maps.
Verified papers.
-
Distributional synthetic controls — Econometrica 91(3), 2023 — DOI 10.3982/ECTA18260, arXiv:2001.06118.
-
An optimal transport approach to estimating causal effects via nonlinear difference-in-differences — arXiv 2021 — arXiv:2108.05858. Generalizes changes-in-changes to multivariate outcomes; reanalysis of a classic minimum-wage dataset finds substitution from full- to part-time labour.
-
Optimal transport weights for causal inference — arXiv 2021 — arXiv:2109.01991. Balancing weights that minimize an OT distance between treated and control covariate laws.
-
Optimal transport for counterfactual estimation: a method for causal inference — arXiv 2023 — arXiv:2301.07755.
Software. R DiSCos (CRAN; distributional synthetic controls); POT for custom weights.
Data needs. Unit-level micro-data per period (e.g. order sizes per region per month); a pool of untreated units; several pre-periods.
Failure modes. Few control units → weights unstable; pre-period fit can be good by chance (use placebo/permutation inference); spillovers violate assumptions.
Potential: MEDIUM–HIGH. Valuable when evaluating planning policies (pricing, assortment, process changes) where the mean hides the story; less central than DRO for day-to-day risk.
§6. Multivariate quantiles, OT ranks, OT conformal prediction, multivariate VaR regions Medium (conformal: speculative-but-promising)
Core idea. There is no natural ordering in , so "the 95% quantile of a vector of P&L lines" is ill-defined. Center-outward quantiles define it via the OT map pushing the data law to the uniform law on the unit ball :
Quantile regions are nested, distribution-free with probability content , and capture non-elliptical shapes — a principled multivariate VaR / stress region. Pairing OT ranks with split-conformal calibration gives multivariate prediction regions with finite-sample coverage.
Verified papers.
-
Distribution and quantile functions, ranks and signs in dimension d: a measure transportation approach — Annals of Statistics 49(2), 2021 — DOI 10.1214/20-AOS1996 (preprint arXiv:1806.01238, earlier title).
-
Center-outward quantiles and the measurement of multivariate risk — arXiv 2019 — arXiv:1912.04924. Smooth approximations of empirical center-outward transports, giving new empirical multivariate risk measures (via the convex potential or the volumes of quantile regions).
-
Multivariate rank-based distribution-free nonparametric testing using measure transportation — arXiv 2019 (journal not confirmed) — arXiv:1909.08733.
-
Optimal transport-based conformal prediction — arXiv 2025 — arXiv:2501.18991.
-
Multivariate conformal prediction using optimal transport — arXiv 2025 — arXiv:2502.03609.
Software. POT (ot.emd to a uniform grid on the ball) is enough to build empirical center-outward ranks. No maintained dedicated package was verified (§16).
Data needs. Hundreds+ multivariate observations; grid sizes grow with , so practical for or so.
Failure modes. Curse of dimensionality in the OT map; computational cost exact; region estimates jagged at small ; 2025 conformal work is new and lightly tested.
Potential: MEDIUM (risk regions), speculative-but-promising (OT conformal bands for multi-line P&L or joint demand).
§7. Drift, change-point and regime detection Medium–High
Core idea. Monitor for a feature, residual or return distribution. In 1-D it is a quantile comparison — cheap, interpretable in the units of the variable ("the distribution has moved by 3.2 units of mass-weighted distance"), and sensitive to shape, not just mean.
Wasserstein -means clusters rolling windows of returns into regimes using between empirical laws as the dissimilarity and barycenters as centroids.
Verified papers.
-
Monitoring for a change point in a sequence of distributions — Annals of Statistics 49(4), 2021, 2271–2291 (journal record verified; no arXiv ID found).
-
Clustering market regimes using the Wasserstein distance — arXiv 2021 — arXiv:2110.11848. Wasserstein -means on empirical return distributions; model-free; compared in the paper against a more traditional (moment-based) clustering approach.
-
backgroundOptimal transport based change point detection and time series segment clustering — arXiv 2019 — arXiv:1911.01325. -
Multivariate goodness-of-fit tests based on Wasserstein distance — arXiv 2020 — arXiv:2003.06684.
Software. scipy.stats.wasserstein_distance; POT ot.wasserstein_1d, ot.sliced_wasserstein_distance; R transport (CRAN 0.15-4).
Data needs. A reference window and streaming data; for regimes, rolling windows (e.g. 20–60 days) of returns.
Failure modes. Thresholds need permutation or bootstrap calibration; serial dependence inflates false alarms; high-dimensional needs slicing; regime labels can be unstable across reruns.
Potential: MEDIUM–HIGH. Directly usable as model-risk drift monitors and as a regime switch feeding allocation or DRO radius choice.
§8. Robust risk measures, stress testing, martingale OT, adapted Wasserstein Medium–High (pricing: Medium)
Core idea A — Wasserstein-robust risk. Report for a risk measure (VaR, CVaR, distortion). For distortion risk measures there are closed or near-closed forms; first-order sensitivity is informally (informal, see paper for exact conditions)
which turns stress testing into "which loss gradients matter most".
Core idea B — martingale OT (MOT). Model-free price bounds for path-dependent claims given observed option marginals: optimize over couplings that are martingales,
On a grid this is an LP.
Core idea C — adapted Wasserstein. Ordinary between path laws ignores information flow, so two processes can be close in but induce very different optimal-stopping or hedging values. Adapted (causal / nested) distances fix this — the right distance for robustness of multistage decisions.
Verified papers.
-
Robust distortion risk measures — arXiv 2022 (v3; journal not confirmed) — arXiv:2205.08850.
-
Sensitivity analysis of Wasserstein distributionally robust optimization problems — Proceedings of the Royal Society A, 2021 — DOI 10.1098/rspa.2021.0176, arXiv:2006.12022.
-
Computational methods for martingale optimal transport problems — arXiv 2017 — arXiv:1710.07911.
background -
Robust pricing and hedging of options on multiple assets and its numerics — arXiv 2019 ("forthcoming in SIAM Journal on Financial Mathematics" per arXiv comment) — arXiv:1909.03870. Multi-marginal MOT; two numerical routes — discretization + linear programming on the primal (classical, recommended here) and penalization + deep neural networks on the dual (
EXCEPTIONmention, not recommended). -
Adapted Wasserstein distances and stability in mathematical finance — Finance and Stochastics 24, 2020 — arXiv:1901.07450.
-
Estimating processes in adapted Wasserstein distance — arXiv 2020 (journal not confirmed) — arXiv:2002.07261.
Software. POT and CVXPY/HiGHS for MOT LPs on grids; NumPy for Wasserstein-robust CVaR.
Data needs. Loss/P&L samples (robust risk); option-implied marginals (MOT); path data (adapted).
Failure modes. Bounds can be wide and uninformative; MOT grids explode with assets/periods; adapted distances are computationally heavy beyond a few periods.
Potential: MEDIUM–HIGH for Wasserstein-robust risk reporting and stress ranking; MEDIUM for MOT pricing outside derivatives desks; adapted distances matter for multistage scenario trees.
§9. Matching, demand inversion, Gromov–Wasserstein, forecast reconciliation Medium / Speculative
Core idea A — OT as assignment/demand model. Discrete OT is the assignment/transportation LP planners already use (workers→shifts, stores→DCs). Entropic OT corresponds to logit-type matching and gives demand inversion in discrete choice.
Core idea B — Gromov–Wasserstein (GW). Match two datasets whose items live in different feature spaces by comparing internal distance structures:
Fused GW adds a feature cost. Use: aligning SKU hierarchies after a reorganization, mapping fund universes across data vendors.
Core idea C — reconciliation. Hierarchical forecasts must add up. No published OT-based probabilistic reconciliation was found (§16). An open idea: project an incoherent joint forecast onto the coherent subspace by minimizing , which for Gaussians reduces to Gelbrich-distance projection.
Verified papers.
-
The unreasonable effectiveness of optimal transport in economics — arXiv 2021 — arXiv:2107.04700.
-
Yogurts choose consumers? Estimation of random-utility models via two-sided matching — Review of Economic Studies 89(6), 2022 — arXiv:2111.13744.
-
backgroundFused Gromov–Wasserstein distance for structured objects: theoretical foundations and mathematical properties — arXiv 2018 — arXiv:1811.02834. -
backgroundSliced Gromov–Wasserstein — NeurIPS 2019 — arXiv:1905.10124. -
Context (not OT): Probabilistic forecast reconciliation: properties, evaluation and score optimisation — European Journal of Operational Research 306(2), 2023 — DOI 10.1016/j.ejor.2022.07.040; Hierarchical forecasting with robust reconciliation — arXiv 2025 — arXiv:2510.20383.
Software. POT ot.gromov.gromov_wasserstein, ot.gromov.fused_gromov_wasserstein, ot.emd, ot.sinkhorn.
Failure modes. GW is non-convex (local optima; symmetric structures are ambiguous); entropic matching depends on temperature; reconciliation idea untested. EXCEPTION excluded: neural-embedding entity alignment is out of scope.
Potential: MEDIUM (matching/assignment, demand inversion), SPECULATIVE (GW entity alignment, OT reconciliation).
§10. Tools and statistical rates that matter in practice
Sample complexity — the curse of dimensionality. For an empirical measure of a law in (), : with , halving the error needs more data. Practical consequences:
-
1-D and low-D problems are where OT is statistically cheap ( in 1-D).
-
Entropic OT / Sinkhorn divergences converge at (constants exponential in ).
-
Sliced Wasserstein (average of 1-D projections) has dimension-free rates.
-
WDRO guarantees can avoid the curse with suitably chosen radii (§1, arXiv:2009.04382), and the Gelbrich ball has an explicit dimension-free radius (§2).
Verified references.
-
backgroundSharp asymptotic and finite-sample rates of convergence of empirical measures in Wasserstein distance — arXiv 2017 — arXiv:1707.00087. -
backgroundSample complexity of Sinkhorn divergences — arXiv 2018 — arXiv:1810.02733. -
backgroundStatistical bounds for entropic optimal transport: sample complexity and the central limit theorem — arXiv 2019 — arXiv:1905.11882. -
Statistical and topological properties of sliced probability divergences — NeurIPS 2020 — arXiv:2003.05783.
-
Statistical optimal transport (lecture notes) — arXiv 2024 — arXiv:2407.18163.
Small-N callout (N<100). The curse bites hard above d≈3; at scarce data impose structure (1-D, Gelbrich, residuals) or use task-local √N radii (Gao OR 2023; RWPI) — never a raw N^{-1/d} concentration ball as the decision radius. Exact OT is computationally free at N≤100; prefer ot.emd / 1-D formulas over Sinkhorn (entropic bias can dominate sampling noise). Full toolkit → §11.5.
When to use what.
| Situation | Use | Why |
|---|---|---|
| 1-D planning variable | quantile formulas, ot.wasserstein_1d, scipy.stats.wasserstein_distance |
exact, |
| Low-D, | exact LP ot.emd2 |
exact; cubic cost OK |
| Large or need smoothness | Sinkhorn ot.sinkhorn2 |
fast, differentiable, rates |
| High-D monitoring | sliced Wasserstein ot.sliced_wasserstein_distance |
dimension-free rate |
| Decisions under ambiguity | WDRO LP/SOCP in CVXPY/Pyomo/HiGHS; skwdro |
convex reformulations |
| Mean/covariance only | Gelbrich SOCP | closed form |
| Distribution-valued data | R frechet, WRI; quantile grids + isotonic |
1-D isometry |
| Different feature spaces | POT Gromov–Wasserstein | structure matching |
| N<100 decisions | §11.5 recipes (√N / RWPI / Gelbrich / 1-D quantile) | CV and N^{-1/d} balls fail |
§11. Worked example (computed; Python with NumPy, SciPy-HiGHS, POT 0.9.7)
Script: worked_example.py (seed 20261005). Exact output in worked_example_output.txt.
Part A — Wasserstein-DRO newsvendor versus SAA
Setup. Holding cost , backorder cost (critical ratio ). True demand LogNormal(, 0.6), support for the type-1 LP. Cost . Oracle order , oracle expected cost .
One sample of demands: 42.8, 58.1, 60.4, 71.2, 76.3, 86.9, 88.1, 96.6, 148.3, 209.5. SAA order (empirical 75% quantile) ; in-sample cost 68.601; true expected cost 131.423 (25% above the oracle).
Type-1 () DRO — exact LP reformulation of the dual in §1:
| order | certified worst-case cost | true cost | |
|---|---|---|---|
| 1 | 96.56 | 71.601 | 131.423 |
| 10 | 96.56 | 98.601 | 131.423 |
| 40 | 96.56 | 188.601 | 131.423 |
| 100 | 96.56 | 368.601 | 131.423 |
| 200 | 450.00 | 450.000 | 332.853 |
| 300 | 450.00 | 450.000 | 332.853 |
Reading: the certificate is exactly SAA in-sample cost , and the order does not move — the Lipschitz-regularization effect from §1. Only when the radius is large enough for the adversary to exploit the support cap does the order jump (to an absurdly conservative 450). With unbounded support the order would equal SAA for every (stated from the dual; the run uses a compact support).
Type-2 () DRO — via the strong dual (penalty , quadratic transport cost):
| order | certificate | true cost | |
|---|---|---|---|
| 2 | 97.72 | 72.065 | 130.179 |
| 5 | 99.45 | 77.262 | 128.382 |
| 10 | 102.34 | 85.922 | 125.563 |
| 20 | 108.11 | 103.242 | 120.569 |
| 40 | 119.66 | 137.883 | 112.966 |
Here the order moves smoothly toward the oracle and on this (unlucky, low) sample true cost falls from 131.4 to 113.0.
Monte Carlo (300 independent datasets; true cost evaluated exactly; regret vs oracle 105.504):
| method | mean | P90 | regret | win vs SAA |
|---|---|---|---|---|
| SAA | 114.418 | 127.443 | 8.45% | — |
| , | 114.185 | 127.236 | 8.23% | 0.52 |
| , | 114.076 | 127.926 | 8.12% | 0.51 |
| , | 114.206 | 127.298 | 8.25% | 0.48 |
| , | 115.763 | 131.221 | 9.72% | 0.40 |
| , by CV | 115.082 | 130.188 | 9.08% | 0.30 |
| method | mean | P90 | regret | win vs SAA |
|---|---|---|---|---|
| SAA | 109.581 | 116.877 | 3.86% | — |
| , | 109.569 | 116.448 | 3.85% | 0.46 |
| , | 109.673 | 116.015 | 3.95% | 0.45 |
| , | 110.210 | 117.479 | 4.46% | 0.39 |
| , | 112.493 | 122.526 | 6.62% | 0.30 |
| , by CV | 110.084 | 116.896 | 4.34% | 0.23 |
CV picked with frequencies {98, 58, 56, 50, 38} at and {100, 101, 49, 41, 9} at ("win" counts strict improvements; ties count as non-wins).
Honest takeaways.
-
Small radii give a small average gain (≈0.3 percentage points of regret at ) and essentially none at .
-
Cross-validated radius selection did worse than SAA here — radius choice is the practical bottleneck, consistent with §1's failure modes.
-
DRO's clearest value is (a) a certified worst-case cost and (b) protection on bad samples (the single-sample table).
-
Type-1 DRO leaves 1-D newsvendor decisions unchanged unless support bounds bind.
Part B — 1-D barycenter of three demand-scenario forecasts
Inputs (weights 1/3 each): A "bottom-up" ; B "sales" ; C bimodal . Barycenter by POT's LP barycenter on a grid, checked against direct quantile averaging.
| distribution | mean | sd | P10 | P50 | P90 |
|---|---|---|---|---|---|
| A | 100.00 | 10.00 | 86.9 | 99.8 | 112.6 |
| B | 130.00 | 25.00 | 97.7 | 129.8 | 161.8 |
| C | 110.00 | 31.05 | 73.0 | 109.7 | 146.5 |
| barycenter | 113.33 | 21.58 | 85.9 | 113.1 | 140.3 |
| linear pool (mixture) | 113.33 | 26.81 | 79.9 | 108.3 | 148.3 |
Quantile-average check: P10/P50/P90 = 85.9 / 113.1 / 140.3, identical to the LP (its mean, 113.08, differs only because the grid truncates the extreme 0.05% tails).
distance from each input to the consensus: A 17.87 (barycenter) vs 21.62 (pool); B 17.57 vs 17.29; C 11.46 vs 10.86.
Reading. Same mean; the barycenter is unimodal and tighter (P10–P90 width 54 vs 68), while the pool inherits C's two modes and widens. The barycenter is not uniformly "closer" to the inputs (only to A here). If disagreement between forecasters reflects real uncertainty, the barycenter is under-dispersed — tune with entropic regularization or CRPS-fit weights (§4).
§11.5 Small-N toolkit (N<100)
When this applies
Weekly/monthly demand, short ETF windows, residual series after a simple forecast, or any planning panel with N < 100 observations (often N ≈ 10–50). Complements §1–§2 and §10; numbers below lean on §11 and small_n_radius_output.txt.
Ranking — what to use first on a small panel
| Priority | Use | Skip when |
|---|---|---|
| 1 | 1-D quantile / SAA order statistics (inventory, capacity) | Need multivariate dependence without a 1-D reduction |
| 2 | Gelbrich mean–covariance ball (§2) for portfolios / multi-line risk | Mean/cov untrustworthy (very short, heavy-tailed, N≲20 assets) |
| 3 | Residuals-based W-DRO after a simple forecast (arXiv:2012.01088) | Forecast itself overfits the scarce sample |
| 4 | Type-2 (W₂) DRO with a √N radius (below) | Type-1 suffices for a certificate only |
| 5 | RWPI / Wasserstein-projection radius (no CV) | N≲15 and high-dimensional moment maps (asymptotics thin) |
| Avoid as default | Concentration ball covering | Always too big in at small |
| Avoid as default | LOO / -fold CV for at | §11: CV loses to SAA |
Basics: Why CV fails at N≤30
Holdout variance dominates the DRO signal; §11 CV frequencies pile on yet average true cost rises.
Basics: √N variation radius
Radius of order matching Gao’s finite-sample theory — balances fit vs Lipschitz/gradient variation of the loss.
Basics: Profile / WP radius
Smallest Wasserstein perturbation of that restores an estimating equation ; its null quantiles size DRO without CV.
Radius recipes
A. Variation / finite-sample √N radius (Finite-sample guarantees for WDRO… — Operations Research 2023 — DOI 10.1287/opre.2022.2326, arXiv:2009.04382). Set to balance empirical loss against loss variation (Lipschitz / gradient norm), avoiding the curse. Practical 1-D proxy after scaling:
Report a small grid or freeze on a pre-sample — do not re-CV every period at .
B. RWPI / Wasserstein projection (background Robust Wasserstein profile inference… — JAP 2019 — arXiv:1610.05627; refinement Wasserstein Projection Tests… — arXiv 2024 — arXiv:2408.11753). For estimating-equation problems, take as a -quantile of the profile / WP statistic (limiting -type law). Rates are typically or depending on loss/cost — parametric, not . At –, Bartlett corrections in arXiv:2408.11753 improve quantile accuracy for published confidence statements.
C. Concentration coverage of (background Esfahani–Kuhn — arXiv:1505.05116): . Use for theory or ; not as the default decision radius in at small .
D. Bootstrap frontier philosophy (Calibration of DRO… — Operations Research 2021 — arXiv:1711.06565; -divergence setting): open-loop 90% radii are often too conservative; bootstrap a robust mean–variance frontier. Transfers as a calibration mindset to Wasserstein radii.
Recipes by sample size
| Inventory / 1-D plan | Portfolio / risk | Forecast → buffer | |
|---|---|---|---|
| ≈10 | SAA critical quantile; optional with small fixed or with small (lab: on MAD scale ≈ fixed –); report certificate; no CV | or large- Gelbrich (→ equal weight) | Seasonal mean + tiny residual ball |
| ≈30 | + ; compare to SAA on a chart without retuning | Gelbrich CVaR with , shrinkage cov | Residuals-based W-DRO; permutation test for drift |
| ≈80 | Same with tighter ; light block holdout for OK | Gelbrich comfortable for ETF panels | RWPI/Bartlett radius; scenario-reduce 80→8–15 |
Evidence from this lab
- §11 Monte Carlo (LogNormal demand, , ): at , best fixed cuts mean regret by ~0.3 pp vs SAA; at , essentially no average gain. CV-picked is worse than SAA (win rates 0.30 / 0.23). Type-1 leaves the order unchanged until support binds.
small_n_radius_compare.py(, same truth;small_n_radius_output.txt):- Best average costs: fixed – at –; by – SAA is already hard to beat on average.
- Gao-style with MAD-scale : at , mean (competitive); over-conserves (regret 11–18%). Scale to the loss/ground-metric units — raw is not universal.
- Leave-one-out CV over : win rate vs SAA (), (), () — confirms CV hurts at scarce data.
- External finite-sample newsvendor (How Big Should Your Data Really Be?… — Management Science 2023 — DOI 10.1287/mnsc.2023.4725, arXiv:2107.02742): tens of samples already make SAA strong on relative regret; SAA regret can be non-monotone in ; a convex combination of consecutive order statistics is minimax-optimal. Read: at –, SAA is a serious baseline — DRO’s job is certificate + bad-sample protection, not large average wins.
Drift monitors at short windows
Use 1-D or sliced on rolling windows of length 20–60. Calibrate alarms by permutation, not naive -out-of- bootstrap (Minimax-Optimal Two-Sample Test with Sliced Wasserstein — arXiv:2510.27498; bootstrap inconsistency background arXiv:1610.03287). Covariance barycenters: Generalized bootstrap in the Bures–Wasserstein space — arXiv:2111.12612.
Basics: Permutation vs bootstrap for
Exchangeability → finite-sample Type I control; naive bootstrap of empirical can be inconsistent.
Ambiguity + misspecification (non-stationary short series)
Newsvendor under Ambiguity and Misspecification — arXiv:2405.07008: mean–variance ambiguity with an optimal-transport misspecification penalty; closed-form order; finite-sample bound splitting estimation error vs distribution shift. Relevant when is small and the environment may drift.
Software note for scarce data
At , prefer exact 1-D / LP OT (numpy quantiles, scipy.stats.wasserstein_distance, POT ot.emd2_1d / ot.emd) and HiGHS/CVXPY duals. Sinkhorn is unnecessary and can bias more than sampling noise. skwdro still needs an external radius policy (§11.5 A–B).
§12. Five ranked "brave but within reason" project ideas
1. Gelbrich-robust CVaR allocation and stress report for an ETF panel. (Small-N friendly — preferred when rolling windows are 30–80 weeks.)
-
Hypothesis: the closed-form Gelbrich-robust CVaR portfolio (§2) with improves out-of-sample CVaR and turnover versus Markowitz and Ledoit–Wolf shrinkage, at similar return.
-
Method: SOCP ; calibrate on a pre-sample; produce worst-case mean/covariance as stress scenarios each rebalance. Benchmarks: Markowitz, Ledoit–Wolf, , ridge-penalized with CV radius, -DRO mean-CVaR.
-
Data: daily/weekly ETF total returns (10+ years), rolling windows.
-
Success: lower realized 95% CVaR and max drawdown with Sharpe within noise; lower turnover.
-
Falsification: no out-of-sample CVaR gain versus Ledoit–Wolf over rolling windows (block-bootstrap test), or gains vanish once is fixed ex ante.
-
Effort: 3–5 days.
2. Quantile-averaging consensus for challenger forecasts + residual-based Wasserstein buffers. (Works with short histories if each challenger is low-parameter; size residual balls with §11.5 √N rules, not LOO.)
-
Hypothesis: a CRPS-weighted 1-D barycenter of challenger forecasts beats the linear pool and the best single model on CRPS, and a residuals-based -DRO buffer (§1, arXiv:2012.01088) sizes budget contingencies at lower cost for the same breach rate than SAA quantiles.
-
Method: quantile grids per model; weights by rolling CRPS; entropic widening knob; residual ambiguity set with radius by time-series CV.
-
Data: historical monthly actuals and forecasts by line/region (≥ 36 months).
-
Success: CRPS gain, Diebold–Mariano significant; buffer cost at target breach rate below SAA.
-
Falsification: DM test versus linear pool not significant, or buffer cost ≥ SAA at matched coverage.
-
Effort: 4–7 days.
Basics: Diebold–Mariano (DM) test
Not defined in the notes’ primer (§0/§0.5) or glossary (§14). No definition is added here. The notes use the term only in project idea 2 (§12):
- Success: “CRPS gain, Diebold–Mariano significant; buffer cost at target breach rate below SAA.”
- Falsification: “DM test versus linear pool not significant, or buffer cost ≥ SAA at matched coverage.”
Glossary (§14), for the score it is applied to. CRPS — continuous ranked probability score; for 1-D forecasts it equals the integrated pinball loss.
3. Distributional nowcasting of cross-sections (sector returns, regional growth).
-
Hypothesis: forecasting the whole cross-sectional distribution via Wasserstein autoregression / transport-map AR (§3) beats a random walk and a moments-only AR in error, and its quantiles add information to mean nowcasts.
-
Method: quantile-function panel; WAR (R
WRI) and isotonic transport-map AR; optionally OT-based mixed-frequency steps in a factor model as in the JRSS-A 2026 paper. -
Data: monthly cross-sections of ETF/sector returns or regional indicators, 15+ years.
-
Success: lower out-of-sample and CRPS over rolling 10-year windows.
-
Falsification: no improvement over random walk in error out of sample.
-
Effort: 5–8 days.
4. Wasserstein regime and drift monitor.
-
Hypothesis: WK-means regimes (§7) plus sequential change-point alarms anticipate risk-model breakdowns and can switch the DRO radius in projects 1–2.
-
Method: rolling 1-D on returns/residuals; sliced for multivariate; permutation-calibrated thresholds.
-
Data: the same panels as 1–3.
-
Success: earlier alarms than a trailing-volatility rule at equal false-alarm rate; radius switching improves CVaR.
-
Falsification: adds nothing beyond a trailing-vol threshold.
-
Effort: 4–6 days.
5. Distributional synthetic control for planning-policy evaluation.
-
Hypothesis: distributional synthetic controls (§5) reveal tail effects of a policy (pricing, process change) that mean-based DiD misses.
-
Method: R
DiSCos; placebo-in-space permutation inference. -
Data: unit-level distributions (orders, tickets, lead times) for treated and ≥ 10 control units, several pre-periods.
-
Success: good pre-fit; effects visible in quantiles not means.
-
Falsification: placebo rank .
-
Effort: 3–5 days per case.
Small-N add-on (project-shaped). Freeze a √N / RWPI radius policy for a 1-D newsvendor or capacity buffer on a real series with N∈[10,80]; falsify if out-of-sample cost ≥ SAA at matched certificate level over a rolling chart. Effort: 2–4 days. See §11.5.
Also considered. OT-based reconciliation of hierarchical probabilistic forecasts (open research — §9); a Wasserstein-robust Kalman filter inside a dynamic-factor nowcast (§1); OT conformal regions for multi-line P&L (§6); Gromov–Wasserstein alignment of fund or SKU universes across vendors (§9).
§13. Is anything truly "amazing"?
-
Yes — one result. The Gelbrich mean–covariance closed form (§2): one formula turns any of VaR/CVaR/spectral/mean-std into a robust, convex, regularized portfolio rule with a dimension-free radius, equal weights as the limit, and closed-form worst-case moments for stress reporting. Rare combination of rigor and immediate usability.
-
Quietly excellent. 1-D quantile averaging as forecast combination (§4) and distributional synthetic controls (§5): simple, interpretable, hard to beat as baselines.
-
Promising but early. OT-based multivariate conformal prediction (2025, §6).
-
Not amazing on its own. Type-1 -DRO for 1-D inventory: our example shows decisions often equal SAA and gains are small; value is the certificate.
-
Neural exceptions. None needed. The only neural mentions are flagged
EXCEPTION(a neural dual in one MOT paper; neural-embedding entity alignment) and are excluded from recommendations.
§14. Glossary
-
Coupling / transport plan — a joint distribution with given marginals; "who sends how much mass where".
-
Wasserstein distance — minimum average cost (distance) of moving one distribution onto another.
-
Quantile function — inverse CDF; in 1-D, = distance between quantile functions.
-
Kantorovich–Rubinstein duality — equals the largest mean difference over 1-Lipschitz functions.
-
Entropic OT / Sinkhorn — OT plus an entropy penalty; solved by alternating scaling; fast and smooth.
-
Sinkhorn divergence — debiased entropic OT cost; a valid discrepancy between distributions.
-
Sliced Wasserstein — average of 1-D Wasserstein distances over random projections.
-
Barycenter — Fréchet mean of distributions under ; in 1-D, average quantiles.
-
Linear pool — mixture of forecast densities (averaging probabilities, not quantiles).
-
Gelbrich distance — between Gaussians with given means/covariances; lower bound on for general laws with those moments.
-
SAA — sample average approximation: optimize against the empirical distribution.
-
DRO — distributionally robust optimization: optimize against the worst distribution in an ambiguity set.
-
Ambiguity set / ball radius — set of plausible distributions; radius sets conservatism.
-
Type-1 / type-2 WDRO — ambiguity balls using (Lipschitz-like regularization) or (variance-like regularization).
-
Certificate — the worst-case objective value; an upper bound that holds with stated confidence when the radius is calibrated.
-
CVaR — expected loss in the worst fraction of outcomes.
-
Distortion risk measure — risk measure computed by reweighting quantiles with a distortion function (VaR, CVaR are special cases).
-
Fréchet regression — regression where the response is a metric-space object (e.g. a distribution).
-
Tangent space / log map — linearization of space around a reference distribution; allows linear models.
-
Center-outward quantile/rank — multivariate quantile defined by the OT map to the uniform law on the unit ball.
-
Conformal prediction — calibration method giving finite-sample coverage for prediction sets.
-
Scenario reduction — replacing many scenarios by few weighted ones close in a probability metric.
-
Nested distance / adapted Wasserstein — OT distance between stochastic processes respecting information flow.
-
Martingale OT — OT restricted to martingale couplings; model-free price bounds.
-
Gromov–Wasserstein — OT comparing internal distance structures of two datasets in different spaces.
-
CRPS — continuous ranked probability score; for 1-D forecasts it equals the integrated pinball loss.
-
Markov kernel — a map from inputs to probability distributions; the object studied on the companion page.
RWPI / Wasserstein profile — smallest transport-cost perturbation of the empirical law that restores a moment/estimating equation; used to size DRO radii without CV.
Wasserstein projection (WP) statistic — empirical projection distance onto a moment-constrained set; basis for tests and radius calibration (Bartlett-correctable).
√N variation radius — ambiguity radius of order from finite-sample WDRO theory balancing fit vs loss variation.
Order-statistic policy — inventory/quantile rule that orders the sample and picks (or randomizes between) one or two consecutive ranks; SAA is the -th order statistic.
§15. Sources (title — venue, year — link)
Foundations and surveys
-
Computational Optimal Transport — Foundations and Trends in Machine Learning, 2019 — https://arxiv.org/abs/1803.00567
background -
Distributionally Robust Optimization — Acta Numerica 34, 2025 — https://doi.org/10.1017/S0962492924000084 (arXiv:2411.02549)
-
Statistical optimal transport (lecture notes) — arXiv, 2024 — https://arxiv.org/abs/2407.18163
-
POT: Python Optimal Transport — Journal of Machine Learning Research 22(78), 2021 — https://jmlr.org/papers/v22/20-451.html
-
skwdro: a library for Wasserstein distributionally robust machine learning — arXiv, 2024 — https://arxiv.org/abs/2410.21231
§1 Wasserstein DRO
-
Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations — Mathematical Programming, 2018 — https://arxiv.org/abs/1505.05116
background -
Distributionally robust stochastic optimization with Wasserstein distance — Mathematics of Operations Research (accepted per arXiv) — https://arxiv.org/abs/1604.02199
background Finite-sample guarantees for Wasserstein distributionally robust optimization: breaking the curse of dimensionality — Operations Research, 2023 — https://doi.org/10.1287/opre.2022.2326 (arXiv:2009.04382)
-
Wasserstein distributionally robust optimization and variation regularization — arXiv, 2017/2020 — https://arxiv.org/abs/1712.06050
-
Nash equilibria, regularization and computation in optimal transport-based distributionally robust optimization — arXiv, 2023 — https://arxiv.org/abs/2303.03900
-
Regularization via mass transportation — arXiv, 2017 — https://arxiv.org/abs/1710.10016
background -
Robust Wasserstein profile inference and applications to machine learning — Journal of Applied Probability, 2019 — https://arxiv.org/abs/1610.05627
background -
Confidence regions in Wasserstein distributionally robust estimation — arXiv, 2019/2021 — https://arxiv.org/abs/1906.01614
-
Distributionally robust learning — arXiv monograph, 2021 — https://arxiv.org/abs/2108.08993
-
Residuals-based distributionally robust optimization with covariate information — arXiv, 2020 — https://arxiv.org/abs/2012.01088
-
Data-driven chance constrained programs over Wasserstein balls — arXiv, 2018/2022 — https://arxiv.org/abs/1809.00210
-
On distributionally robust chance constrained programs with Wasserstein distance — arXiv, 2018 — https://arxiv.org/abs/1806.07418
-
A data-driven distributionally robust newsvendor model with a Wasserstein ambiguity set — Journal of the Operational Research Society 72(8), 2021 — https://doi.org/10.1080/01605682.2020.1746203
-
Distributionally robust newsvendor with moment constraints — arXiv, 2020 — https://arxiv.org/abs/2010.16369
-
On affine policies for Wasserstein distributionally robust unit commitment — IEEE CDC 2022 (per arXiv) — https://arxiv.org/abs/2203.15333
-
Outlier-robust Wasserstein DRO — NeurIPS, 2023 — https://arxiv.org/abs/2311.05573
-
Sinkhorn distributionally robust optimization — arXiv, 2021 — https://arxiv.org/abs/2109.11926
-
Wasserstein distributionally robust Kalman filtering — NeurIPS, 2018 — https://arxiv.org/abs/1809.08830
background
23a. Finite-Sample Guarantees for Wasserstein Distributionally Robust Optimization: Breaking the Curse of Dimensionality — Operations Research, 2023 — https://doi.org/10.1287/opre.2022.2326 (arXiv:2009.04382) (venue upgrade; was arXiv-only as item 8)
23b. How Big Should Your Data Really Be? Data-Driven Newsvendor: Learning One Sample at a Time — Management Science, 2023 — https://doi.org/10.1287/mnsc.2023.4725 (arXiv:2107.02742)
23c. Calibration of Distributionally Robust Empirical Optimization Models — Operations Research 69(5), 2021 — https://arxiv.org/abs/1711.06565 (-divergence; bootstrap frontier calibration lesson)
23d. Newsvendor under Ambiguity and Misspecification — arXiv, 2024 — https://arxiv.org/abs/2405.07008
23e. Wasserstein Projection Tests: Higher-Order Asymptotics and Connections to Empirical Likelihood — arXiv, 2024 (v2 2026) — https://arxiv.org/abs/2408.11753 (Bartlett corrections for WP/RWPI quantiles)
§2 Mean–covariance / portfolios
-
Mean-covariance robust risk measurement — arXiv, 2021 (v3 2025); SSRN https://doi.org/10.2139/ssrn.3990847 — https://arxiv.org/abs/2112.09959
-
Distributionally robust mean-variance portfolio selection with Wasserstein distances — arXiv, 2018 — https://arxiv.org/abs/1802.04885
background -
Portfolio optimisation within a Wasserstein ball — arXiv, 2020 — https://arxiv.org/abs/2012.04500
§3 Distributional regression / density time series / nowcasting
-
Fréchet regression for random objects with Euclidean predictors — Annals of Statistics 47(2), 2019 — https://doi.org/10.1214/17-AOS1624
background -
Wasserstein regression — Journal of the American Statistical Association, 2021 — https://doi.org/10.1080/01621459.2021.1956937
-
Wasserstein autoregressive models for density time series — Journal of Time Series Analysis 43(1), 2022 — https://doi.org/10.1111/jtsa.12590
-
Autoregressive optimal transport models — arXiv, 2021 — https://arxiv.org/abs/2105.05439
-
Distribution-on-distribution regression via optimal transport maps — arXiv, 2021 (to appear in Biometrika per arXiv) — https://arxiv.org/abs/2104.09418
-
Short-term forecasting with optimal transport — Journal of the Royal Statistical Society Series A 189(2), 2026 — https://doi.org/10.1093/jrsssa/qnaf036
§4 Barycenters / scenarios
-
Probability forecast combination via entropy regularized Wasserstein distance — Entropy 22(9):929, 2020 — https://doi.org/10.3390/e22090929
-
Scenario reduction revisited: fundamental limits and guarantees — Mathematical Programming — https://doi.org/10.1007/s10107-018-1269-1
-
Optimization-based scenario reduction for data-driven two-stage stochastic optimization — Operations Research 71(4), 2023 — https://doi.org/10.1287/opre.2022.2265
-
Problem-driven scenario clustering in stochastic optimization — arXiv, 2021 — https://arxiv.org/abs/2106.11717
-
Entropic regularization of the nested distance — arXiv, 2021 — https://arxiv.org/abs/2107.09864
§5 Causal
-
Distributional synthetic controls — Econometrica 91(3), 2023 — https://doi.org/10.3982/ECTA18260
-
An optimal transport approach to estimating causal effects via nonlinear difference-in-differences — arXiv, 2021 — https://arxiv.org/abs/2108.05858
-
Optimal transport weights for causal inference — arXiv, 2021 — https://arxiv.org/abs/2109.01991
-
Optimal transport for counterfactual estimation: a method for causal inference — arXiv, 2023 — https://arxiv.org/abs/2301.07755
§6 Multivariate quantiles / conformal
-
Distribution and quantile functions, ranks and signs in dimension d: a measure transportation approach — Annals of Statistics 49(2), 2021 — https://doi.org/10.1214/20-AOS1996
-
Center-outward quantiles and the measurement of multivariate risk — arXiv, 2019 — https://arxiv.org/abs/1912.04924
-
Multivariate rank-based distribution-free nonparametric testing using measure transportation — arXiv, 2019 — https://arxiv.org/abs/1909.08733
-
Optimal transport-based conformal prediction — arXiv, 2025 — https://arxiv.org/abs/2501.18991
-
Multivariate conformal prediction using optimal transport — arXiv, 2025 — https://arxiv.org/abs/2502.03609
§7 Drift / regimes / tests
-
Monitoring for a change point in a sequence of distributions — Annals of Statistics 49(4), 2021, 2271–2291 — journal record (no arXiv ID found)
-
Clustering market regimes using the Wasserstein distance — arXiv, 2021 — https://arxiv.org/abs/2110.11848
-
Optimal transport based change point detection and time series segment clustering — arXiv, 2019 — https://arxiv.org/abs/1911.01325
background -
Multivariate goodness-of-fit tests based on Wasserstein distance — arXiv, 2020 — https://arxiv.org/abs/2003.06684
50a. Minimax-Optimal Two-Sample Test with Sliced Wasserstein — arXiv, 2025 — https://arxiv.org/abs/2510.27498
50b. Generalized bootstrap in the Bures–Wasserstein space — arXiv, 2021 (v3 2026) — https://arxiv.org/abs/2111.12612
50c. Inference for empirical Wasserstein distances on finite spaces — Annals of Statistics (per arXiv), 2017 — https://arxiv.org/abs/1610.03287
background
§8 Risk / pricing / processes
-
Robust distortion risk measures — arXiv, 2022 — https://arxiv.org/abs/2205.08850
-
Sensitivity analysis of Wasserstein distributionally robust optimization problems — Proceedings of the Royal Society A, 2021 — https://doi.org/10.1098/rspa.2021.0176
-
Computational methods for martingale optimal transport problems — arXiv, 2017 — https://arxiv.org/abs/1710.07911
background -
Robust pricing and hedging of options on multiple assets and its numerics — arXiv, 2019 (forthcoming SIAM J. Financial Mathematics per arXiv) — https://arxiv.org/abs/1909.03870
-
Adapted Wasserstein distances and stability in mathematical finance — Finance and Stochastics 24, 2020 — https://arxiv.org/abs/1901.07450
-
Estimating processes in adapted Wasserstein distance — arXiv, 2020 — https://arxiv.org/abs/2002.07261
§9 Matching / GW / reconciliation
-
The unreasonable effectiveness of optimal transport in economics — arXiv, 2021 — https://arxiv.org/abs/2107.04700
-
Yogurts choose consumers? Estimation of random-utility models via two-sided matching — Review of Economic Studies 89(6), 2022 — https://arxiv.org/abs/2111.13744
-
Fused Gromov–Wasserstein distance for structured objects: theoretical foundations and mathematical properties — arXiv, 2018 — https://arxiv.org/abs/1811.02834
background -
Sliced Gromov–Wasserstein — NeurIPS, 2019 — https://arxiv.org/abs/1905.10124
background -
Probabilistic forecast reconciliation: properties, evaluation and score optimisation — European Journal of Operational Research 306(2), 2023 — https://doi.org/10.1016/j.ejor.2022.07.040 (context, not OT)
-
Hierarchical forecasting with robust reconciliation — arXiv, 2025 — https://arxiv.org/abs/2510.20383 (context, not OT)
§10 Rates
-
Sharp asymptotic and finite-sample rates of convergence of empirical measures in Wasserstein distance — arXiv, 2017 — https://arxiv.org/abs/1707.00087
background -
Sample complexity of Sinkhorn divergences — arXiv, 2018 — https://arxiv.org/abs/1810.02733
background -
Statistical bounds for entropic optimal transport: sample complexity and the central limit theorem — arXiv, 2019 — https://arxiv.org/abs/1905.11882
background -
Statistical and topological properties of sliced probability divergences — NeurIPS, 2020 — https://arxiv.org/abs/2003.05783
Software (verified to exist)
-
POT (Python Optimal Transport) — https://pythonot.github.io — functions used/cited:
ot.wasserstein_1d,ot.emd2_1d,ot.emd,ot.emd2,ot.sinkhorn2,ot.sliced_wasserstein_distance,ot.lp.barycenter,ot.bregman.barycenter,ot.gromov.gromov_wasserstein,ot.gromov.fused_gromov_wasserstein -
skwdro — https://skwdro.readthedocs.io (PyPI
skwdro) -
R
transport(CRAN, 0.15-4) — https://CRAN.R-project.org/package=transport -
R
frechet(CRAN) — https://CRAN.R-project.org/package=frechet -
R
WRI(CRAN; Wasserstein regression and inference, includesWARp) — https://CRAN.R-project.org/package=WRI -
R
DiSCos(CRAN; distributional synthetic controls) — https://CRAN.R-project.org/package=DiSCos -
WKF (MATLAB code for Wasserstein-robust Kalman filtering) — https://github.com/sorooshafiee/WKF
-
SciPy (
scipy.stats.wasserstein_distance,scipy.optimize.linprogwith HiGHS), CVXPY, Pyomo, python-mip — standard open-source solvers/modelling layers.
§16. Verification notes and open uncertainties
Checked 2026-10-05 against arXiv API metadata/abstracts, Crossref/DOI landing pages, CRAN pages and JMLR. The mean–covariance paper (§2) was read in full; the others from abstracts (plus key sections where noted). Small-N addendum papers (items 23a–23e, 50a–50c) verified the same day via arXiv API + Crossref (MS 2023 DOI for 23b; OR 2023 DOI for 8/23a).
Small-N section (§11.5) distilled from
small_n_addendum.md; radius comparison numbers fromsmall_n_radius_output.txt/small_n_radius_compare.py.-
Not found / could not verify:
- Any paper on OT-based hierarchical forecast reconciliation — none found; §9 presents it as an open idea.
- A credit-portfolio-specific 2020+ Wasserstein stress-testing paper — not found; §8 covers generic Wasserstein-robust risk measures and sensitivity instead.
- A maintained package for center-outward ranks/quantiles — none verified; build with POT.
-
No arXiv version found (verified via journal/DOI instead): items 18, 35, 47, 61 and 32.
-
Venues taken only from arXiv comments (not independently confirmed): items 7 (MOR), 20 (CDC 2022), 31 (Biometrika), 54 (SIAM J. Financial Mathematics). Journal of item 24 not confirmed (arXiv + SSRN only). Items 30, 44, 51, 56 carry no confirmed journal.
-
Informal content: the first-order sensitivity formula in §8 is a heuristic summary — see item 52 for exact conditions. Fréchet-regression weights in §3 are described qualitatively.
-
Correction vs a common citation: the Wasserstein autoregressive density time-series model (item 29) is often misattributed; the JTSA paper and arXiv record are the authoritative source.
-
Neural content: none recommended.
EXCEPTIONmentions only: the deep-network dual route in item 54, and neural-embedding entity alignment (excluded from §9). -
Worked example (§11) is fully reproducible from
worked_example.py; numbers in this file are copied fromworked_example_output.txt.
Companion page: Optimal transport on kernels: learning guide