The Universal Warmup Path: Many Routes, One Compass
Abstract
Sampler transitions are local, but their efficiency is governed by global posterior geometry.
Warmup bridges the two by tuning the step size, metric, and related controls.
Although these adaptation mechanisms are individually well studied, their orchestration is still commonly encoded through fixed schedules and heuristic choices: users preselect the metric family, compute budget, and response to incompatible geometry.
We recast that orchestration as evidence-based routing within a declared budget.
The Universal Warmup Path uses one sampler-independent compass, $\Sigma_\pi=\operatorname{Cov}_\pi(X)$, while allowing each route to deploy its own metric.
Its discipline---gather evidence, act, wait, or refuse---is sampler-independent; we evaluate one gradient-based HMC-family realization using scalar gates.
The confidence-aware design gives route-attractor guarantees, while a finite-transcript bound limits what confined evidence can establish.
When local and global evidence agree, the path deploys an efficient local metric; disagreement fails loudly through reparameterization advice or population handoff, never certifying global coverage.
Across the cells we tested, automatic warmup outperformed the predeclared Fisher low-rank primary, with geometric-mean ESS-per-gradient ratios of $1.409$--$2.451$ on the ill-conditioned suite and $1.131$--$1.951$ on German credit.
It also improved ESS per gradient over the predeclared fixed-schedule diagonal control while meeting the same declared post-sampling quality criterion.
The proposed path points toward a coherent theory of sampler hyperparameter tuning, connecting local adaptation, global geometry, and explicit refusal in practical controllers.
이 뉴스, 어떠셨어요?
탭 한 번으로 반응 · 로그인 불필요