Bayesian Comparison between MCMC, PMCMC, and VI in Nonlinear Time Series
DOI:
https://doi.org/10.59992/IJFAES.2026.v5n5p7Keywords:
Bayesian approach, parameter estimation, MCMC, PMCMC, VI, Nonlinear time seriesAbstract
Nonlinear time series models have gained significant attention in applied studies due to their ability to represent complex dynamical properties, such as fluctuation clustering, system transitions, and common non-Gaussian characteristics in financial data. This study aims to develop a general Bayesian framework for estimating and comparing nonlinear time series models within a state-space framework. The proposed framework integrates three key components: flexible model construction, coherent formulation of prior distributions, and modern computational inference techniques, including data augmentation particle-based Markov Monte Carlo (MCMC) algorithms and inverse methods (VI).To evaluate the performance of these methods under different sample sizes, a comprehensive simulation study was conducted using a stochastic fluctuation model for data generation. The results showed that the Bayesian methods provide high-precision parameter estimates, reliable latent state retrieval, and good uncertainty calibration. The study also demonstrated the superiority of the MCMC approach in small samples and in prediction accuracy, while the variance method exhibited high computational efficiency, despite its tendency to systematically underestimate subsequent uncertainty. To highlight the practical application of the proposed framework, it was applied to two sets of real data: one financial and the other numerical time series. The suitability of the models was evaluated using a range of Bayesian predictive diagnostic tools, such as one-step cross-validation, information criteria, and post-prediction tests. Overall, the proposed Bayesian framework offers a comprehensive and consistent methodology for addressing estimation and prediction issues in nonlinear time series analysis.
References
[1] Kastner, J., and Froehworth-Schneiter, S. (2021). Estimating time-varying variability using Bayes in multiple dimensions. Journal of Econometrics.
[2] Jensen, M. J., and Maheu, J. M. (2022). Bayesian stochastic variability models and their financial applications. Econometrics and Statistics.
[3] Kwan, S. M., & Liu, T. (2009). Nonlinear time series prediction using neural networks and switching systems models. International Journal of Prediction.
[4] Särkkä, S., & Svensson, L. (2023). Bayesian filtering and smoothing (Vol. 17). Cambridge university press.
[5] Vehtari, A., Gelman, A., Simpson, D., Carpenter, B., & Bürkner, P. C. (2021). Rank-normalization, folding, and localization: An improved R ̂ for assessing convergence of MCMC (with discussion). Bayesian analysis, 16(2), 667-718.
[6] Yao, Y., Vehtari, A., & Gelman, A. (2022). Stacking for non-mixing Bayesian computations: The curse and blessing of multimodal posteriors. Journal of Machine Learning Research, 23(79), 1-45.
[7] West, M., & Harrison, J. (1997). Bayesian forecasting and dynamic models. New York, NY: Springer New York.
[8] Siu, T. K. (2023). Bayesian nonlinear expectation for time series modelling and its application to Bitcoin. Empirical Economics, 64(1), 505–537. https://doi.org/10.1007/s00181-022-02255-z
[9] Jasra, A., Kamatani, K., & Wu, A. (2025). Bayesian inference for non-synchronously observed diffusions. SIAM/ASA Journal on Uncertainty Quantification. https://doi.org/10.1137/25M175319X.
[10] Zhang, C., Bütepage, J., Kjellström, H., & Mandt, S. (2019). Advances in variational inference. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41(8), 2008–2026. https://doi.org/10.1109/TPAMI.2018.2889774
[11] Shapovalova, Y. (2021). Exact and approximate methods for Bayesian inference: Stochastic volatility case study. Entropy, 23(4), 466. https://doi.org/10.3390/e23040466
[12] Naesseth, C. A., Linderman, S. W., Ranganath, R., & Blei, D. M. (2018). Variational sequential Monte Carlo. Proceedings of the 21st International Conference on Artificial Intelligence and Statistics (AISTATS), 968–977. https://arxiv.org/abs/1705.11140.
