Group: Administrators
Posts: 4.5K,
Visits: 1.6K
|
Module 12: Multiple regression variance of least squares estimators practice problems (The attached PDF file has better formatting.) ** Exercise 12.1: Multiple regression variance of least squares estimators A regression equation with two explanatory variables is Yi = á + â1 X1i + â2 X2i + åi, with X1 = (1, 2, 3, 4, 5) (xi – )2 = 10 RSS (the residual sum of squares) = 9.3333 N (number of observations) = 5 ñ (X1, X2), the correlation of X1 and X2, is –0.7 What is s2, the ordinary least squares estimator for ó2å? What is (xi – )2? What is R21,2, the R2 of X1 regressed on X2? What is ó2(B1), the variance of B1, where B1 is the ordinary least squares estimator of â1? What is ó(B1), the standard error of B1? Part A: s2, the ordinary least squares estimator for ó2å (the square of the standard error of the regression) = the residual sum of squares (RSS) divided by the degrees of freedom, or N–k–1 (the number of observations – the number of explanatory variables – 1) = 0.93333 / (5 - 2 - 1) = 4.6667. Part B: = (1+2+3+4+5) / 5 = 3, so (xi – )2 = (–2)2 + (–1)2 + (0)2 + (+1)2 + (+2)2 = 10. Part C: ñ(X1, X2) = –0.7, so R2 (X1, X2) = 0.49. The values of ñ(X1, Y) = 0.1 and ñ(X2, Y) are not relevant. Part D: ó2(B1), the variance of B1, = [ s2 / (xi – )2 ] / [ 1 – R2 (X1, X2) ] = 0.91503. The estimated value of B1 is not relevant. Part E: ó(B1), the standard error of B1, is the square root of ó2(B1), the variance of B1: 0.915030.5 = 0.95657. With two explanatory variables, the square of the correlation of X1 with X2 is the same as the R2 value of X1 regressed on X2. With more than two explanatory variables, we must use the R2 of the regression, not the correlations among the explanatory variables. ** Exercise 12.2: Degrees of freedom of F-statistic A regression model has N data points, k explanatory variables (ß’s), and an intercept. An F-test for the null hypothesis that q slopes are 0 has how many degrees of freedom in the numerator? This F-test has how many degrees of freedom in the denominator? Part A: The F-test says: "How much additional predictive power does the model under review have compared to what we would otherwise use, as a ratio to the total predictive power of the model under review?" Each part of this ratio is adjusted for the degrees of freedom. The degrees of freedom in the numerator adjusts for the extra predictive power of the model under review stemming from additional explanatory variables. If the model under review has one extra explanatory variable, it predicts better even if this extra explanatory variable has no actual correlation with the response variable. The degrees of freedom is the number of extra explanatory variables, or q. If the F-test has a p-value of P% with q degrees of freedom in the numerator, its p-value is more than P% with q+1 degrees of freedom in the numerator. A higher p-value means that it is more likely that the observed increase in predictive power reflects the spurious effects of additional explanatory variables. Part B: The degrees of freedom for the model under review is N – k – 1; this is the degrees of freedom in the denominator of the F-ratio. As N increases but no other parameters change, the additional predictive power of the model under review is less likely to be spurious (more likely to be real), so the p-value decreases
|