Bayesian approach for neural networks--review and case studies
- PMID: 11341565
- DOI: 10.1016/s0893-6080(00)00098-8
Bayesian approach for neural networks--review and case studies
Abstract
We give a short review on the Bayesian approach for neural network learning and demonstrate the advantages of the approach in three real applications. We discuss the Bayesian approach with emphasis on the role of prior knowledge in Bayesian models and in classical error minimization approaches. The generalization capability of a statistical model, classical or Bayesian, is ultimately based on the prior assumptions. The Bayesian approach permits propagation of uncertainty in quantities which are unknown to other assumptions in the model, which may be more generally valid or easier to guess in the problem. The case problem studied in this paper include a regression, a classification, and an inverse problem. In the most thoroughly analyzed regression problem, the best models were those with less restrictive priors. This emphasizes the major advantage of the Bayesian approach, that we are not forced to guess attributes that are unknown, such as the number of degrees of freedom in the model, non-linearity of the model with respect to each input variable, or the exact form for the distribution of the model residuals.
Similar articles
-
Invariance priors for Bayesian feed-forward neural networks.Neural Netw. 2006 Dec;19(10):1550-7. doi: 10.1016/j.neunet.2006.01.017. Epub 2006 Mar 31. Neural Netw. 2006. PMID: 16580175
-
Bayesian applications of belief networks and multilayer perceptrons for ovarian tumor classification with rejection.Artif Intell Med. 2003 Sep-Oct;29(1-2):39-60. doi: 10.1016/s0933-3657(03)00053-8. Artif Intell Med. 2003. PMID: 12957780
-
BELM: Bayesian extreme learning machine.IEEE Trans Neural Netw. 2011 Mar;22(3):505-9. doi: 10.1109/TNN.2010.2103956. Epub 2011 Jan 20. IEEE Trans Neural Netw. 2011. PMID: 21257373
-
Bayesian regularization of neural networks.Methods Mol Biol. 2008;458:25-44. doi: 10.1007/978-1-60327-101-1_3. Methods Mol Biol. 2008. PMID: 19065804 Review.
-
A higher order Bayesian neural network with spiking units.Int J Neural Syst. 1996 May;7(2):115-28. doi: 10.1142/s0129065796000816. Int J Neural Syst. 1996. PMID: 8823623 Review.
Cited by
-
Joint segmentation and image reconstruction with error prediction in photoacoustic imaging using deep learning.Photoacoustics. 2024 Sep 11;40:100645. doi: 10.1016/j.pacs.2024.100645. eCollection 2024 Dec. Photoacoustics. 2024. PMID: 39347464 Free PMC article.
-
Robust Gaussian Process Regression Method for Efficient Tunneling Pathway Optimization: Application to Surface Processes.J Chem Theory Comput. 2024 May 14;20(9):3766-3778. doi: 10.1021/acs.jctc.4c00158. Epub 2024 May 6. J Chem Theory Comput. 2024. PMID: 38708859 Free PMC article.
-
A novel neural network-based framework to estimate oil and gas pipelines life with missing input parameters.Sci Rep. 2024 Feb 24;14(1):4511. doi: 10.1038/s41598-024-54964-3. Sci Rep. 2024. PMID: 38402261 Free PMC article.
-
Bridging semiempirical and ab initio QM/MM potentials by Gaussian process regression and its sparse variants for free energy simulation.J Chem Phys. 2023 Aug 7;159(5):054107. doi: 10.1063/5.0156327. J Chem Phys. 2023. PMID: 37530109 Free PMC article.
-
Bayesian logical neural networks for human-centered applications in medicine.Front Bioinform. 2023 Feb 15;3:1082941. doi: 10.3389/fbinf.2023.1082941. eCollection 2023. Front Bioinform. 2023. PMID: 36875147 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources