• simple linear regression: model a response as a straight line in one predictor , the simplest case of linear regression
- $\beta_0$ intercept: predicted $Y$ at $X = 0$
- $\beta_1$ slope: expected change in $Y$ per one unit of $X$
	- example: predicting material strength from temperature, $\beta_1 = 2$ means each extra 1°C adds 2 units of strength on average
- $\epsilon$ error: noise and everything the line leaves out
- with $k$ predictors it's multiple regression, $Y = \beta_0 + \beta_1 X_1 + \dots + \beta_k X_k + \epsilon$, each slope read with the others held fixed
  • fit by least squares: choose the line minimizing
  • ANOVA table: split the variation and test the model as a whole
sourceSSdfMSF
regressionSSR
residualSSE
totalSST
- $H_0$: every slope is 0, $X$ says nothing about $Y$ ( [[Null Hypothesis]] ); $H_1$: at least one slope isn't ( [[Hypothesis Testing]] )
- with one predictor ( $k = 1$ ) the $F$ test is the $t$ test on $\hat{\beta}_1$, $F = t^2$
  • checking the fit
    • : share of the variation in the line explains, near 1 is a tight fit
    • adjusted penalizes extra predictors, only matters in multiple regression
    • each coefficient gets its own p-value, below 0.05 is the usual “significant”
  • assumptions: linear relationship, independent observations, plus constant variance and roughly normal errors for the tests to hold