# Prediction Intervals (Conformal Predictions) for Regression Problems

Cross Validated Asked by bioinformatics_student on December 29, 2021

So I’ve been looking into the idea of looking into conformal predictions, or to obtain prediction intervals instead of just single point predictions. Basically my take is that I would have my deep learning model (NN) that predicts the residual for this to be useful. However by using some distance function for this it will only be as meaningful as it is correlated to the error, which begs the question, wouldn’t it better to predict the error directly with a separate model?

I came across this post Prediction Intervals for ML Models and thought it would be interesting to apply to my own models. In my case I am dealing with a ML regression model to predict the stability of my proteins and wish to define at the end in 5 steps or less.

1. Data Splitting
2. Training the Model
3. Calibrating the model or measuring the skewness of the predictions (original labels vs predicted labels).

I was thinking of using a secondary model such as the KNN to measure the differences between labels.

1. Obtaining prediction intervals
2. Evaluating prediction intervals

Basically my question at the end of this is that would this be the correct way to do this or is this even smart to do? If so what would be the best approach for this?

Thanks for any input.

# Possible Output

Sequence  Prediction Interval

AABBD     [0.24, 0.77]
AABCD     [0.36, 0.75]


Conformal Predictions Overview

## Related Questions

### ARIMA(0,0,0) model but residuals not white noise

0  Asked on November 30, 2020 by mathias-schinnerup-hejberg

### Conditional Multivariate Gaussian Identity

1  Asked on November 29, 2020 by statian

### Interpreting infinite odds ratio and confidence interval from Fisher’s test

2  Asked on November 29, 2020

### Log-likelihood of Normal Distribution: Why the term $frac{n}{2}log(2pi sigma^2)$ is not considered in the minimization of SSE?

1  Asked on November 29, 2020 by javier-tg

### Significant change over NxM distributions

0  Asked on November 29, 2020

### Random distribution which statistical method

0  Asked on November 29, 2020 by theundecided

### Bayes Optimal Classification Rule

1  Asked on November 28, 2020 by john

### Calculate confidence interval over Relative Prediction Error

1  Asked on November 28, 2020 by xeon123

### What could be a good way to interpret this neurophysiological data?

0  Asked on November 28, 2020 by ystein-dunker

### The definition of natural cubic splines for regression

2  Asked on November 28, 2020 by durin

### Why do we need to emphasize sufficient statistics in generalized linear models?

0  Asked on November 27, 2020 by tranquil-coder

### How to impose restrictions on a random matrix via its prior distribution?

1  Asked on November 27, 2020 by souled_outt

### Bounds for the expectation of the max

1  Asked on November 27, 2020 by user3285148

### In OLS, when absolute value of the coefficient of a independent variable is large, does it mean this independent variable is more important?

0  Asked on November 26, 2020 by duke-yue

### How to estimate click through rate lift for a ranking model?

0  Asked on November 26, 2020 by etang

### Comparing percentages based on likert scale by year

1  Asked on November 26, 2020 by chris-beeley

### The probability that the minimum of a multivariate Gaussian exceeds zero

0  Asked on November 26, 2020 by jld

### Cohen’s Kappa for more than two categories

1  Asked on November 25, 2020 by asra-khalid

### How can I forecast with multiple time series sampled at different frequencies?

1  Asked on November 25, 2020 by dkent

Get help from others!