Year: 2026
Type: preprint
Abstract: Bayes factors are a widely used model comparison criterion, but are often quite challenging and computationally expensive to estimate well. We propose a variation of the model-switch thermodynamic integration method for estimating Bayes factors that decreases the variance of the estimator and essentially eliminates integration error. We choose samples whose density in $β$ is proportional to the standard deviation of previously drawn samples. Rather than averaging many samples at each $β$, we use a very dense set of $β$ values, collecting one sample at each in order of increasing $β$ and one sample at each in order of decreasing $β$ to minimize "thermic lag". We study our procedure with a toy model (based loosely on some signal recovery problems). In this model we find that adaptive sampling gives us a 2.7-fold decrease in the spread of the estimated Bayes factor. We test our procedure both drawing directly from the posterior distribution and using a Markov Chain Monte Carlo sampler.
Source: arXiv (Cornell University)
Authors: Malnati, Amanda, Kralj, Megan, Olum, Ken D.
Institution: Tufts University
Language: English
Subfield: Statistics and Probability
Field: Mathematics
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7223064039