Logistic Regression

Which Test: Logistic Regression or Discriminant Function Analysis

September 17, 2021

Discriminant Function Analysis (DFA) and Logistic Regression (LR) are so similar, yet so different. Which one when, or either at any time? Let’s see….   DISCRIMINANT FUNCTION ANALYSIS (DFA): Is used to model the value (exclusive group membership) of a either a dichotomous or a nominal dependent variable (outcome) based on its relationship with one or more continuous scaled independent variables (predictors). A predictive model consisting of one or more discriminant functions (based on the linear combinations of the predictor variables that provide the best discrimination between the [READ MORE]

So many regression procedures. Confused?

August 11, 2021

Regression is the work-horse  of research analytics. It has been around for a long time and it probably will be around for a long time to come. Whether we always realise it or not, most of our analytical tools are in some way or another based on the concept of correlation and regression.   Let us look at a few regression-based procedures in the researchers’ toolbox:   1. Simple and multiple linear regression: Applicable if both the single dependent variable (outcome or response variable) and one or many independent variables (predictors) are measured on an interval scale. If we [READ MORE]

Data Assumptions: Its about the residuals, and not the variables’ raw data

April 12, 2021

Normality, or normal distributions is a very familiar term but what does it really mean and what does it refer to…   In linear models such as ANOVA and Regression (or any regression-based statistical procedures), an important assumptions is “normality”. The question is whether it refers to the outcome (dependent variable “Y”), or the predictor (independent variable “X”). We should remember that the true answer is “none of the above”.    In linear models where we look at the relationship between dependent and independent variables, our [READ MORE]

Which Test: Chi-Square, Logistic Regression, or Log-linear analysis

August 19, 2019

In a previous post I have discussed the differences between logistic regression and discriminant function analysis, but how about log-linear analysis? Which, and when, to choose between chi-square, logistic regression, and log-linear analysis? Lets briefly review each of these statistical procedures: The chi-square test (χ²) is a descriptive statistic, just as correlation is descriptive of the association between two variables. Chi-square is not a modeling technique, so in the absence of a dependent (outcome) variable, there is no prediction of either a value (such as in ordinary [READ MORE]