Cross Validated Asked by bioinformatics_student on December 29, 2021

So I’ve been looking into the idea of looking into conformal predictions, or to obtain prediction intervals instead of just single point predictions. Basically my take is that I would have my deep learning model (NN) that predicts the residual for this to be useful. However by using some distance function for this it will only be as meaningful as it is correlated to the error, which begs the question, wouldn’t it better to predict the error directly with a separate model?

I came across this post Prediction Intervals for ML Models and thought it would be interesting to apply to my own models. In my case I am dealing with a ML regression model to predict the stability of my proteins and wish to define at the end in 5 steps or less.

- Data Splitting
- Training the Model
- Calibrating the model or measuring the skewness of the predictions (original labels vs predicted labels).

*I was thinking of using a secondary model such as the KNN to measure the differences between labels.*

- Obtaining prediction intervals
- Evaluating prediction intervals

Basically my question at the end of this is that would this be the correct way to do this or is this even smart to do? If so what would be the best approach for this?

Thanks for any input.

```
Sequence Prediction Interval
AAADD [0.34, 0.67]
AABBD [0.24, 0.77]
AABCD [0.36, 0.75]
```

0 Asked on November 30, 2020 by mathias-schinnerup-hejberg

1 Asked on November 30, 2020 by shiladitya-basu

1 Asked on November 29, 2020 by statian

conditional probability gaussian process multivariate normal

2 Asked on November 29, 2020

1 Asked on November 29, 2020 by javier-tg

machine learning maximum likelihood normal distribution optimization

0 Asked on November 29, 2020

0 Asked on November 29, 2020 by theundecided

1 Asked on November 28, 2020 by john

1 Asked on November 28, 2020 by xeon123

0 Asked on November 28, 2020 by ystein-dunker

accuracy interpretation medicine ratio sensitivity specificity

2 Asked on November 28, 2020 by durin

0 Asked on November 27, 2020 by tranquil-coder

generalized linear model maximum likelihood sufficient statistics

1 Asked on November 27, 2020 by souled_outt

1 Asked on November 27, 2020 by user3285148

0 Asked on November 26, 2020 by duke-yue

0 Asked on November 26, 2020 by etang

1 Asked on November 26, 2020 by chris-beeley

0 Asked on November 26, 2020 by jld

distributions extreme value normal distribution order statistics probability

1 Asked on November 25, 2020 by asra-khalid

1 Asked on November 25, 2020 by dkent

Get help from others!

Recent Answers

- Peter Machado on Why fry rice before boiling?
- Joshua Engel on Why fry rice before boiling?
- Lex on Does Google Analytics track 404 page responses as valid page views?
- Jon Church on Why fry rice before boiling?
- haakon.io on Why fry rice before boiling?

Recent Questions

- How Do I Get The Ifruit App Off Of Gta 5 / Grand Theft Auto 5
- Iv’e designed a space elevator using a series of lasers. do you know anybody i could submit the designs too that could manufacture the concept and put it to use
- Need help finding a book. Female OP protagonist, magic
- Why is the WWF pending games (“Your turn”) area replaced w/ a column of “Bonus & Reward”gift boxes?
- Does Google Analytics track 404 page responses as valid page views?

© 2023 AnswerBun.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP