Skip to content

Statistics · Tests and models

Logistic Regression for Binary Outcomes

How logistic regression models yes/no outcomes such as renewal or purchase, how to read its odds ratios and predicted probabilities, and which mistakes to avoid in survey data.

ModQu research article · 714 words · 5 references (APA 7th edition)

Download PDF

Many business questions have only two possible answers. Did the customer renew? Would the respondent recommend the brand? Did the visitor buy? Logistic regression is the standard tool for relating a yes/no outcome to one or more explanatory variables. It was developed for exactly this kind of data (Cox, 1958) and is now one of the most widely used models in market research, epidemiology and the social sciences (Hosmer et al., 2013).

Why not ordinary regression?

An ordinary straight-line regression on a 0/1 outcome can predict "probabilities" below 0 or above 1, and it assumes the effect of a predictor is the same everywhere on the scale. In reality, a one-point rise in satisfaction matters little for customers who are already almost certain to renew, and a great deal for customers who are undecided. Logistic regression solves both problems by modelling the probability through an S-shaped curve that always stays between 0 and 1.

The model

Instead of modelling the probability p directly, logistic regression models the log-odds, or logit, as a linear function of the predictors:

log(p ÷ (1 − p)) = β0 + β1x1 + … + βkxk

The odds, p ÷ (1 − p), compare the chance that something happens with the chance that it does not. Coefficients are estimated by maximum likelihood rather than least squares. Logistic regression belongs to the wider family of generalised linear models, which link a linear predictor to outcomes that are not normally distributed.

A worked example

Suppose a hypothetical subscription survey of 1,200 customers records whether each customer renewed and their satisfaction score from 0 to 10. The fitted model is:

logit(p) = −4.0 + 0.8 × score

The coefficient 0.8 is on the log-odds scale, which few people find intuitive. Exponentiating it gives the odds ratio: e0.8 ≈ 2.23, so each extra point of satisfaction multiplies the odds of renewal by about 2.2. Converting back to probabilities is often clearer still. A customer scoring 3 has a predicted renewal probability of 17%, a customer scoring 5 has 50%, and a customer scoring 8 has 92%.

Line chart of predicted probability of renewal against satisfaction score from 0 to 10. Individual respondents appear as dots at 0% or 100%. The logistic curve rises in an S shape from about 2% to 98%, passing 17% at a score of 3, 50% at 5 and 92% at 8. A dashed straight-line fit drops below 0% at low scores and rises above 100% at high scores.
Figure 1. Predicted probability of renewal by satisfaction score. The logistic curve stays between 0% and 100%, while a straight-line fit to the same data does not. Illustrative data; chart by ModQu.

Note that the same 0.8 coefficient moves the probability by different amounts at different points on the curve: from 3 to 4 adds about 14 percentage points, while from 8 to 9 adds only about 5. For business audiences, reporting predicted probabilities or average marginal effects is usually more meaningful than reporting log-odds.

Practical guidance for survey and business data

Common mistakes

Key takeaways

Logistic regression is the natural first model for any yes/no outcome. It keeps predictions between 0 and 1, gives effects as odds ratios, and converts easily to predicted probabilities that decision-makers understand. Use it with enough events per predictor, survey-aware estimation and clear reporting of probabilities rather than log-odds alone.

References

Cox, D. R. (1958). The regression analysis of binary sequences. Journal of the Royal Statistical Society Series B: Statistical Methodology, 20(2), 215–232. https://doi.org/10.1111/j.2517-6161.1958.tb00292.x

Hosmer, D. W., Jr., Lemeshow, S., & Sturdivant, R. X. (2013). Applied logistic regression (3rd ed.). Wiley. https://doi.org/10.1002/9781118548387

King, G., & Zeng, L. (2001). Logistic regression in rare events data. Political Analysis, 9(2), 137–163. https://doi.org/10.1093/oxfordjournals.pan.a004868

Mood, C. (2010). Logistic regression: Why we cannot do what we think we can do, and what we can do about it. European Sociological Review, 26(1), 67–82. https://doi.org/10.1093/esr/jcp006

Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996). A simulation study of the number of events per variable in logistic regression analysis. Journal of Clinical Epidemiology, 49(12), 1373–1379. https://doi.org/10.1016/S0895-4356(96)00236-3