Cross Validated Asked by Milan Bosnic on January 5, 2022

I’m working on a problem with 3 possible outcomes and a bunch of features. I have a regression model that outputs probabilities for each category and I’d like to extend these probabilities to probability distributions. So instead of getting an output of `[0.2,0.3,0.5]`

, I’d get a probability density function or at least a quantification of the uncertainty of the prediction. I’ve looked into some models that give these distributions but haven’t found any way to use it on a multiple output problem. Is there any way to do this?

Interesting problem - which is most often overlooked in data science and machine learning. The output probabilities $bf{y}$ are indeed estimates of the underlying (true) posterior probabilities (your $[0.2,0.3,0.5]$). Sampling a different training set (from your presupposed 'oracle'), will yield a slightly different set of output probabilities, when the identical input feature vector $bf{x}$ is presented to the classifier.

The distributions of $hat{P}(bf{y} mid bf{x},bf{theta})$ - they have been studied for linear and quadratic discriminant analysis ($theta$ is the parameter vector of the discriminant classifier).

And yes, also the sufficient parameters of these distributions of $hat{P}(bf{y} mid bf{x},bf{theta})$ have been derived. Specifically the **variance** of each posterior probability has been derived. A mathematically sound description (with the relevant references to papers in the statistical literature), can be found in Chapter 11 in the book: Discriminant analysis and statistical pattern recognition by G.J. McLachlan, Wiley (2004).

Answered by Match Maker EE on January 5, 2022

0 Asked on December 11, 2021 by isobel-m

1 Asked on December 10, 2021 by code_diy

3 Asked on December 8, 2021 by skoestlmeier

2 Asked on December 8, 2021 by unistudent87

3 Asked on December 8, 2021 by rockthestar

1 Asked on December 8, 2021

1 Asked on December 8, 2021 by kev8484

32 Asked on December 8, 2021

0 Asked on December 8, 2021

0 Asked on December 8, 2021 by likao

0 Asked on December 8, 2021

0 Asked on December 8, 2021 by thetagang

0 Asked on December 8, 2021

categorical data generalized linear model multiple regression regression

0 Asked on December 8, 2021

2 Asked on December 8, 2021 by sadisha

1 Asked on December 8, 2021

machine learning multiple regression regression standardization

0 Asked on December 8, 2021

machine learning neural networks q learning references reinforcement learning

1 Asked on December 8, 2021 by user292136

1 Asked on December 6, 2021 by hulk

Get help from others!

Recent Questions

- How Do I Get The Ifruit App Off Of Gta 5 / Grand Theft Auto 5
- Iv’e designed a space elevator using a series of lasers. do you know anybody i could submit the designs too that could manufacture the concept and put it to use
- Need help finding a book. Female OP protagonist, magic
- Why is the WWF pending games (“Your turn”) area replaced w/ a column of “Bonus & Reward”gift boxes?
- Does Google Analytics track 404 page responses as valid page views?

Recent Answers

- Lex on Does Google Analytics track 404 page responses as valid page views?
- Peter Machado on Why fry rice before boiling?
- Jon Church on Why fry rice before boiling?
- haakon.io on Why fry rice before boiling?
- Joshua Engel on Why fry rice before boiling?

© 2023 AnswerBun.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP