Cross Validated Asked by Milan Bosnic on January 5, 2022

I’m working on a problem with 3 possible outcomes and a bunch of features. I have a regression model that outputs probabilities for each category and I’d like to extend these probabilities to probability distributions. So instead of getting an output of `[0.2,0.3,0.5]`

, I’d get a probability density function or at least a quantification of the uncertainty of the prediction. I’ve looked into some models that give these distributions but haven’t found any way to use it on a multiple output problem. Is there any way to do this?

Interesting problem - which is most often overlooked in data science and machine learning. The output probabilities $bf{y}$ are indeed estimates of the underlying (true) posterior probabilities (your $[0.2,0.3,0.5]$). Sampling a different training set (from your presupposed 'oracle'), will yield a slightly different set of output probabilities, when the identical input feature vector $bf{x}$ is presented to the classifier.

The distributions of $hat{P}(bf{y} mid bf{x},bf{theta})$ - they have been studied for linear and quadratic discriminant analysis ($theta$ is the parameter vector of the discriminant classifier).

And yes, also the sufficient parameters of these distributions of $hat{P}(bf{y} mid bf{x},bf{theta})$ have been derived. Specifically the **variance** of each posterior probability has been derived. A mathematically sound description (with the relevant references to papers in the statistical literature), can be found in Chapter 11 in the book: Discriminant analysis and statistical pattern recognition by G.J. McLachlan, Wiley (2004).

Answered by Match Maker EE on January 5, 2022

2 Asked on November 24, 2021 by dmittal

2 Asked on November 24, 2021 by appleseed

confidence interval missing data multiple imputation multiple regression regression

0 Asked on November 24, 2021 by mrmartin

1 Asked on November 24, 2021

mixed model multilevel analysis multiple regression regression coefficients repeated measures

0 Asked on November 24, 2021

3 Asked on November 24, 2021

generalized linear model regression regression coefficients standard error statistical significance

1 Asked on November 24, 2021 by jack-arthur

1 Asked on November 24, 2021

0 Asked on November 24, 2021 by doug-sponsler

0 Asked on November 24, 2021

0 Asked on November 24, 2021

computer vision neural networks optical character recognition pattern recognition

0 Asked on November 24, 2021 by zhutchens1

1 Asked on November 24, 2021

conditional expectation conditional probability econometrics expected value regression

0 Asked on November 24, 2021 by chiara-toschi

1 Asked on November 24, 2021 by tzirtzi

1 Asked on November 21, 2021 by user3358740

1 Asked on November 21, 2021 by scott-thibault

1 Asked on November 21, 2021 by arctan27

1 Asked on November 21, 2021

multilevel analysis multiple regression poisson regression regression repeated measures

Get help from others!

Recent Questions

- How Do I Get The Ifruit App Off Of Gta 5 / Grand Theft Auto 5
- Iv’e designed a space elevator using a series of lasers. do you know anybody i could submit the designs too that could manufacture the concept and put it to use
- Need help finding a book. Female OP protagonist, magic
- Why is the WWF pending games (“Your turn”) area replaced w/ a column of “Bonus & Reward”gift boxes?
- Does Google Analytics track 404 page responses as valid page views?

Recent Answers

- Jon Church on Why fry rice before boiling?
- Peter Machado on Why fry rice before boiling?
- Lex on Does Google Analytics track 404 page responses as valid page views?
- Joshua Engel on Why fry rice before boiling?
- haakon.io on Why fry rice before boiling?

© 2023 AnswerBun.com. All rights reserved. Sites we Love: PCI Database, MenuIva, UKBizDB, Menu Kuliner, Sharing RPP, SolveDir