Work

Rate, Leakage, and Distortion for Stationary Gaussian Sources: Water-Filling on a Tilted Spectrum

Year: 2026
Type: preprint
Abstract: Manuscript prepared for the IEEE Transactions on Information Theory (version tit-stationary-1.4), with its sources, check scripts and their recorded outputs, the notebook that reruns the checks, the Lean 4 module, and a short companion note on Observation Theory. An encoder describes part of a stationary Gaussian vector process to a decoder under a weighted quadratic distortion. A second party holds a noisy filtered observation of the process and never decodes. The description has two costs per symbol, its rate and its conditional leakage to the second party. For memoryless sources the frontier is reverse water-filling on the decoder's weight tilted by the second party's information. We show that for sources with memory the same holds frequency by frequency, under one water level. For a periodic source the region splits exactly over the Fourier frequencies, and it converges to a spectral region as the period grows. For a scalar process with a scalar context the minimum leakage is an integral of a closed form, and the two optimal descriptions can occupy disjoint bands. A delay in the second party's observation changes nothing when it keeps its whole observation. For the stationary source we prove that the spectral region is the operational region, with deterministic encoders, for every continuous positive definite spectral density matrix and a second party that observes the process through a filter with a continuous frequency response in noise of continuous positive definite spectrum. The region is unchanged when that party has its whole observation process, not only the part during the coded block. When that party's map is memoryless and its noise white, finite-window costs converge to the spectral cost from above, with a gap at most a constant over the window length for Lipschitz spectra.
Language: English
Open Access status: green
OpenAlex ID: W7236694706
Cites: 1
Cited by:
Related to: 10