Toggle Main Menu Toggle Search

Open Access padlockePrints

Generalized Bayesian Inference for Discrete Intractable Likelihood

Lookup NU author(s): Takuo Matsubara, Professor Chris Oates

Downloads

Full text for this publication is not currently held within this repository. Alternative links are provided below where available.


Abstract

© 2023 American Statistical Association. Discrete state spaces represent a major computational challenge to statistical inference, since the computation of normalization constants requires summation over large or possibly infinite sets, which can be impractical. This article addresses this computational challenge through the development of a novel generalized Bayesian inference procedure suitable for discrete intractable likelihood. Inspired by recent methodological advances for continuous data, the main idea is to update beliefs about model parameters using a discrete Fisher divergence, in lieu of the problematic intractable likelihood. The result is a generalized posterior that can be sampled from using standard computational tools, such as Markov chain Monte Carlo, circumventing the intractable normalizing constant. The statistical properties of the generalized posterior are analyzed, with sufficient conditions for posterior consistency and asymptotic normality established. In addition, a novel and general approach to calibration of generalized posteriors is proposed. Applications are presented on lattice models for discrete spatial data and on multivariate models for count data, where in each case the methodology facilitates generalized Bayesian inference at low computational cost. Supplementary materials for this article are available online.


Publication metadata

Author(s): Matsubara T, Knoblauch J, Briol F-X, Oates CJ

Publication type: Article

Publication status: Published

Journal: Journal of the American Statistical Association

Year: 2023

Pages: Epub ahead of print

Online publication date: 12/09/2023

Acceptance date: 30/08/2023

ISSN (print): 0162-1459

ISSN (electronic): 1537-274X

Publisher: Taylor and Francis Ltd

URL: https://doi.org/10.1080/01621459.2023.2257891

DOI: 10.1080/01621459.2023.2257891


Altmetrics

Altmetrics provided by Altmetric


Funding

Funder referenceFunder name
Data Centric Engineering, Alan Turing Institute
EP/W005859/1
EPSRC
EP/N510129/1

Share