The Stability Landscape in Wave-Packet Scattering: Geometric Rigidity and Sharp Sobolev Thresholds

A central challenge in modern harmonic analysis is to quantify the balance between the approximation power of finely resolved multiscale representations and their robustness to nonlinear changes of coordinates, a problem arising naturally in signal processing and partial differential equations.

Motivated by Mallat's pioneering results on the wavelet scattering transform, we identify a sharp resolution--robustness trade-off for scattering-type nonlinear multiscale representations built upon general wave-packet systems, showing that stability under small diffeomorphisms is governed by the geometry of the underlying frequency decomposition.

In particular, for wave-packet systems with finer transverse resolution than wavelets, including curvelets and shearlets, we establish a geometric rigidity phenomenon: arbitrarily small, smooth, compactly supported deformations can move high-frequency mass across adjacent channels, leading to instability already at the first scattering layer.

We complement this obstruction by identifying the sharp Sobolev threshold for deformation stability: below the critical regularity no Mallat-type estimate can hold, while at and above it stability is recovered by means of matched commutator bounds that allow deformations to be propagated through the frequency channels.

Together, these results provide a systematic deformation-stability theory for Euclidean scattering transforms and yield the first stability estimates intrinsic to the scattering architecture beyond the classical wavelet setting.