# Iterative regression

Cross Validated Asked by Baron Yugovich on January 1, 2022

What’s the correct term for regression where you first regress on one input variable (feature), take the errors, regress on the next feature, etc.? In what specific cases is this useful? Are there any references for this technique?

More specifically, I am talking about regressing $$y$$ on $$x_1$$, then regressing $$(y-b_1times x_1)$$ on $$x_2$$, etc. This is because each $$x$$ is a time series, and needs to be sampled differently, so I cannot take them all as inputs to the regression at the same time.

Are you talking about 'step-wise regression'? However, in step-wise regression, we regress response on one variable, then we regress response on the new selected variable as well as the previous variable, i.e. regress response on two variables. Next, we regress response on three variables and so on.

Answered by user4704857 on January 1, 2022

Taking some liberties, you are probably talking about the instrumental variable techniques, or IV. They are used to help argue causality and to control for endogenous variables. Commonly part of econometrics.

Alternatively, you may be thinking of the FWL theorem

Answered by RegressForward on January 1, 2022

## Related Questions

### Number of samples and R^2

1  Asked on November 16, 2021 by ss_19

### Linear regression is a estimation of conditional expectation?

2  Asked on November 16, 2021 by javier-mario

### What is the correct way of adding bias terms in the residuals of the linear regression model?

1  Asked on November 14, 2021 by gruangly

### Does correlation between residuals of ARIMA models for two time series tell anything about how they fluctuate together?

2  Asked on November 14, 2021 by sztal

### Precision vs. Accuracy when talking about MSE

1  Asked on November 14, 2021

### How to run svy: regress in R or get R-squared in R for complex survey data

4  Asked on November 14, 2021

### Loss function for regression with uncertain labels

1  Asked on November 14, 2021

### Classification with noisy labels, noise is structured and not random

0  Asked on November 14, 2021

### Error propagation in an equation without an analytical solution

0  Asked on November 14, 2021 by slekce

### Calculating the Hazard Ratio for a Cox-regression model stratified by a variable (R)

2  Asked on November 14, 2021 by frenchtoast

### Normalizing zero inflated predictors for multiple regression

0  Asked on November 14, 2021 by eugen-cuic

### Should we always calculate the z in a confidence interval as 1 – (alpha/2)?

1  Asked on November 14, 2021

### What are the contours lines on the Cook’s list vs Leverage h_ii / (1-h_ii) plot?

1  Asked on November 14, 2021 by user291965

### Should multivariate time series by normalized in any way before fitting a VAR model?

0  Asked on November 14, 2021 by theqman

### Sample Size Calculation – Two Independent Means

1  Asked on November 14, 2021 by user291972

### Unbiased estimatior for $bar{x}$ from a Random Sample with unequal selection probability

1  Asked on November 14, 2021 by planderos33

### How the concordance index is calculated in Cox model if the actual event times are not predicted?

2  Asked on November 14, 2021

### How to estimate the leafsize of the kd-tree?

1  Asked on November 12, 2021 by curiosus

### Understanding the Stata margins command on dichotomous variables

1  Asked on November 12, 2021