Abstract
Using maximum likelihood (ML) estimation for discrete choice modeling of small datasets causes two problems. The first problem is that the data may exhibit separation, in which case the ML estimates do not exist. Also, provided they exist, the ML estimates are biased. In this paper, we show how to adapt Firth's penalized likelihood estimation for use in discrete choice modeling. A powerful advantage of Firth's estimation is that, unlike ML estimation, it provides useful estimates in the case of data separation. For aggregates of six or more respondents, Firth estimates have negligible bias. For preference estimates on an individual level, Firth estimates show little bias as long as each person evaluates a sufficient number of choice sets. Additionally, Firth's individual-level estimation makes it possible to construct an empirical distribution of the respondents' preferences without imposing any a priori population distribution and to effectively predict people's choices and detect market segments. Segment recovery may even be better when individual-level estimates are obtained using Firth's method instead of hierarchical Bayes estimation under a normal prior. We base all findings on data from a stated choice study on various forms of employee compensation.
Original language | English |
---|---|
Pages (from-to) | 1-21 |
Number of pages | 21 |
Journal | Journal of Choice Modelling |
Volume | 31 |
DOIs | |
Publication status | Published - Jun 2019 |
Externally published | Yes |
Event | Interdisciplinary Choice Workshop (ICW 2018) - Santiago, Chile Duration: 7 Aug 2018 → 10 Aug 2018 |
Keywords
- Discrete choice modeling
- Data separation
- Firth's penalized maximum likelihood
- Hierarchical Bayes estimation
- Individual-level estimates
- Market segmentation