4: Regression Analysis

Question 1

_____:

1. Dependent Variable:
   Also known as the response or outcome variable, it is the variable that is being predicted or explained in the regression model.
2. Independent Variable(s):
   These are the predictor variables that are used to explain or predict the variation in the dependent variable.
3. Regression Equation:
   The mathematical formula that represents the relationship between the dependent variable and the independent variable(s).
4. Coefficients:
   In regression, coefficients represent the estimated relationship between each independent variable and the dependent variable.
5. Residuals:
   The differences between the observed values of the dependent variable and the values predicted by the regression equation.

Answer 1

Key Concepts

Question 1

_____ is a statistical technique used to model the relationship between one dependent variable and one or more independent variables. It aims to understand how the independent variables impact the dependent variable and to make predictions based on this relationship.

Answer 1

Regression analysis

Question 2

_____:

1. Simple Linear Regression:
   Involves one independent variable and one dependent variable. It models a linear relationship between the two.
2. Multiple Linear Regression:
   Involves multiple independent variables and one dependent variable. It models a linear relationship between the independent variables and the dependent variable.
3. Logistic Regression:
   Used when the dependent variable is categorical (usually binary). It models the probability of a certain outcome occurring.
4. Polynomial Regression:
   Allows for modeling relationships that are not strictly linear by adding polynomial terms (e.g., quadratic, cubic) to the regression equation.
5. Ridge Regression and Lasso Regression:
   Variations of linear regression include regularization to prevent overfitting and handle multicollinearity.

Answer 2

Types of Regression

Question 3

_____:

1. Data Collection and Preparation:
   Gather relevant data and prepare it for analysis.
2. Model Specification:
   Decide which independent variables to include in the model.
3. Model Estimation:
   Use statistical software to estimate the coefficients and other parameters of the regression model.
4. Model Evaluation:
   Assess the goodness of fit, interpret coefficients, and check assumptions.
5. Prediction and Inference:
   Use the model to make predictions and draw inferences about the relationships between variables.

Answer 3

Steps in Regression Analysis

Question 4

The _____ in regression analysis:

1. Linearity: This assumption states that the relationship between the independent variable(s) and the dependent variable is linear. In other words, the change in the dependent variable is proportional to changes in the independent variable(s).
2. Independence of Errors: This assumes that the errors (residuals) in the regression model are independent of each other. This means that the error term for one observation should not provide information about the error term for another observation.
3. Homoscedasticity: Also known as constant variance, this assumption means that the variance of the errors is consistent across different levels of the independent variable(s). In other words, the spread of the residuals should be the same for all values of the independent variable(s).
4. Normality of Errors: This assumption suggests that the errors in the regression model follow a normal distribution. This is important because many statistical techniques rely on the assumption of normality.

Answer 4

four key assumptions