Classical DFM forecasting anchors
- Stock & Watson — dynamic factor models for large panels; diffusion-index / factor-augmented forecasting. Textbook reference for "few latent factors drive co-movement; forecast via estimated factors."
- Banbura, Giannone & Reichlin — nowcasting with mixed-frequency / ragged-edge data via state-space DFMs and Kalman filtering/smoothing; EM for parameters. The operational template for "publish forecasts as data arrive asymmetrically." Mechanism: observation equation \(y_t = \Lambda f_t + e_t\), factor dynamics (VAR), missing entries handled by Kalman with time-varying observation selection; typically Gaussian likelihood / quadratic loss.
These anchors define what a true intersection must touch: factors + missingness + real-time information sets — not merely OT somewhere near time series.
Sinkhorn divergence as loss
- Cuturi (2013) — entropic regularization makes OT differentiable/scalable via Sinkhorn–Knopp matrix scaling.
- Genevay / Feydy-style Sinkhorn divergence — debiased Sinkhorn loss \(S_\varepsilon(\mu,\nu) = OT_\varepsilon(\mu,\nu) - \tfrac12 OT_\varepsilon(\mu,\mu) - \tfrac12 OT_\varepsilon(\nu,\nu)\), usable as a training criterion between empirical measures (batches, predictive residual clouds, feature distributions).
In forecasting, Sinkhorn-as-loss usually means: match distributions (or feature measures), not just pointwise MSE — useful when phase/shape errors matter or when imputing under a distributional invariance prior (Spelta's "two batches, same law").
True intersection: Spelta et al. (JRSS-A 2025)
Proposes a Sinkhorn-divergence loss that treats two batches from the same dataset as sharing a distribution, for filling missing low-frequency entries, and adds that Sinkhorn step as a complement to the EM algorithm of a Dynamic Factor Model, with Monte Carlo and US GDP nowcasting evidence.
Not in the arXiv priority_brief (paywalled journal; no arXiv abs found in cached hits).
Adjacent clusters — what each is not
| Cluster | Cite | Why adjacent, not true ∩ |
|---|---|---|
| N-BEATS + Sinkhorn alignment | Lee et al., 2305.15196 | Stack-wise Sinkhorn on N-BEATS features for domain generalization — no DFM / ragged-edge nowcasting. |
| SWIFT Wasserstein factorization | Afshar et al., 2010.04081 | Tensor CP under Wasserstein loss — static factorization, not dynamic factors for forecasting. |
| R-WAE | Han et al., 2101.07496 | Recurrent Wasserstein AE for sequential disentanglement — generative seq model, not DFM nowcasting. |
| COT-GAN | Xu et al., 2006.08571 | Causal OT + Sinkhorn for sequential GANs — adversarial generation, not factor state-space. |
| Spatial Sinkhorn forecast verification | Francis et al., 2412.16063 | Sinkhorn as verification metric for precipitation fields — eval, not DFM training. |
| Nonlinear filter Sinkhorn stability | Mandal et al., 2208.10810 | Sinkhorn/Wasserstein to probe filter stability (PF/EnKF) — diagnostic, not panel DFM loss. |
| Topological Sinkhorn TSC | Stephen, 1902.05326 | Sinkhorn on persistence diagram KDEs — classification, not forecasting DFM. |
| Chaos OT regularization | Melo et al., 2604.21097 | Sinkhorn/WGAN OT to match attractor statistics — emulator fidelity, not macro panel factors. |
| q-fin martingale Sinkhorn | e.g. 2310.13797, 1902.04456 | Sinkhorn for martingale OT / IV surfaces / SV calibration — finance math, not DFM nowcasting. |
| Precipitation U-Net nowcasting | Rahimi et al., 2307.10843 | Nowcasting with Wasserstein-ish distributional checks — CNN-LSTM, not DFM. |
True ∩ (external to brief): Spelta et al. (2025) JRSS-A — Sinkhorn loss + DFM-EM for nowcasting/short-term forecasting.
Research recipe: DFM / state-space + Sinkhorn observation loss
Goal (generic financial / macro panel): Improve ragged-edge multi-series short-horizon forecasts by replacing or augmenting Gaussian observation likelihood with a Sinkhorn divergence between predicted and observed panel distributions, following the Spelta-style "distribution-preserving imputation" idea.
Assumptions
- Approximate low-rank factor structure: \(y_t = \Lambda f_t + e_t\), \(f_t\) VAR / state-space.
- Missingness is ragged-edge / publication lag, treated as missing-at-random conditional on the information set at forecast origin \(t_0\) (no peeking at same-period revisions released later).
- Sinkhorn acts on empirical measures over cross-section and/or residual batches, not on a single scalar target only.
- Entropic regularization \(\varepsilon\) chosen for stability; debiasing (Sinkhorn divergence) preferred over raw \(OT_\varepsilon\).
Protocol (leakage-safe)
- Walk-forward: expanding or rolling origin; at each origin, use only data that would have been available (vintage / pseudo-real-time mask).
- No same-period leakage: never train or evaluate with contemporaneous realizations that arrive after the decision time; hold out the full evaluation window from \(\varepsilon\) / factor-count tuning (nested walk-forward).
- Imputation vs prediction: if Sinkhorn fills missing entries inside EM, freeze filled values for out-of-sample scoring against eventual releases; score point (RMSE/MAE) and distributional (Sinkhorn / CRPS) metrics separately.
Candidate nulls / baselines
- Classical Gaussian DFM + Kalman (MSE) — Banbura/Giannone/Reichlin-style.
- Same DFM with Student-t / Huber observation loss (robustness without OT).
- Sinkhorn-only nonparametric imputer without factors (Spelta stand-alone arm).
- Factor model + MSE, then Sinkhorn only as evaluation metric (not train).
- Adjacent deep baseline: Feature-aligned N-BEATS + Sinkhorn (2305.15196) on the same panel.
Success criteria (scientific, not commercial)
- Statistically better short-horizon scores vs (1) on held-out origins, with Diebold–Mariano or similar.
- Gains concentrated where raggedness is severe (ablate missingness rate).
- Ablation: remove Sinkhorn step → performance collapses toward MSE-DFM; remove factors → collapses toward nonparametric OT imputer.
Top citations
- Stock & Watson — dynamic factor / diffusion-index forecasting (classical DFM).
- Banbura, Giannone & Reichlin — DFM nowcasting with ragged edge / Kalman.
- Cuturi (2013) + Genevay/Feydy Sinkhorn divergence — OT loss technology.
- Spelta, Pagnottoni & Pecora (JRSS-A 2025) — DFM-EM + Sinkhorn loss nowcasting. DOI 10.1093/jrsssa/qnaf036.
- Lee et al. 2305.15196 — strongest adjacent forecasting+Sinkhorn deep baseline.
Open questions
- Is Sinkhorn best as an EM augmentation (Spelta), a direct observation loss in gradient-based state-space learning, or only an evaluation metric?
- How to define the ground metric on heterogeneous financial panels (scales, signs, mixed frequencies)?
- Computational scaling: Sinkhorn per EM iteration vs large \(N\) panels — when does it dominate Kalman cost?
- Does distributional matching help tail events / crises, or only average nowcast RMSE?
- Identification: can Sinkhorn over-smooth factor dynamics and hurt multi-step forecasts?
- Replication: open re-implementation of Spelta DFM+Sinkhorn on a generic public panel (e.g. FRED-MD style) under strict vintage rules.
Tooling notes (this run)
- OpenAlex /
feynman rankand raw arXiv API hit 429 earlier in the workflow; abs HTML cache +arxiv_hits.json+priority_brief.mdwere the reliable literature substrate. - Jev Ultrafast successfully opened the Spelta JRSS-A landing page — critical because the true ∩ paper was journal-first, not in the arXiv brief.
- Feynman (GLM via NVIDIA NIM) was used for one-shot synthesis from the brief head.