[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
IDEAS home Printed from https://ideas.repec.org/p/ags/aaea16/235990.html
   My bibliography  Save this paper

The Order of Variables, Simulation Noise and Accuracy of Mixed Logit Estimates

Author

Listed:
  • Palma, Marco
  • Li, Yajuan
  • Vedenov, Dmitry
  • Bessler, David
Abstract
The simulated choice probabilities in Mixed Logit are approximated numerically from a multidimensional integral with a mixing distribution from a multivariate density function of the random parameters. Theoretically the order in which the variables are estimated should not matter; however, due to the inherent simulation ‘noise’ the magnitude of the estimated coefficients differs depending on the arbitrarily selected order in which the random variables enter the estimation procedure. This problem is exacerbated with a low number of draws or if correlation among coefficients is allowed. If correlation among the random parameters is allowed the variable ordering effects arise from simulation noise and from the Cholesky factorization used to allow for correlation. Ignoring the potential ordering effects in simulated maximum likelihood estimation methods seriously compromises the ability for replicating the results and can inadvertently influence policy recommendations. The simulation noise is independent of the number of integrating dimensions for random draws, but it increases for Halton draws. Hence, better coverage is achieved with Halton draws for small integrating dimensions, but random draws provide better coverage for larger dimensions.

Suggested Citation

  • Palma, Marco & Li, Yajuan & Vedenov, Dmitry & Bessler, David, 2016. "The Order of Variables, Simulation Noise and Accuracy of Mixed Logit Estimates," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 235990, Agricultural and Applied Economics Association.
    • Handle: RePEc:ags:aaea16:235990
    DOI: 10.22004/ag.econ.235990
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/235990/files/OrderV2-short.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.235990?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. David M. Drukker & Richard Gates, 2006. "Generating Halton sequences using Mata," Stata Journal, StataCorp LP, vol. 6(2), pages 214-228, June.
    2. McFadden, Daniel & Ruud, Paul A, 1994. "Estimation by Simulation," The Review of Economics and Statistics, MIT Press, vol. 76(4), pages 591-608, November.
    3. Bhat, Chandra R., 2001. "Quasi-random maximum simulated likelihood estimation of the mixed multinomial logit model," Transportation Research Part B: Methodological, Elsevier, vol. 35(7), pages 677-693, August.
    4. Lorenzo Cappellari & Stephen P. Jenkins, 2006. "Calculation of multivariate normal probabilities by simulation, with applications to maximum simulated likelihood estimation," Stata Journal, StataCorp LP, vol. 6(2), pages 156-189, June.
    5. Kenneth Train ., 2000. "Halton Sequences for Mixed Logit," Economics Working Papers E00-278, University of California at Berkeley.
    6. Train,Kenneth E., 2009. "Discrete Choice Methods with Simulation," Cambridge Books, Cambridge University Press, number 9780521766555.
    7. Geweke, John & Keane, Michael P & Runkle, David, 1994. "Alternative Computational Approaches to Inference in the Multinomial Probit Model," The Review of Economics and Statistics, MIT Press, vol. 76(4), pages 609-632, November.
    8. Pesaran, H. Hashem & Shin, Yongcheol, 1998. "Generalized impulse response analysis in linear multivariate models," Economics Letters, Elsevier, vol. 58(1), pages 17-29, January.
    9. David Revelt & Kenneth Train, 1998. "Mixed Logit With Repeated Choices: Households' Choices Of Appliance Efficiency Level," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 647-657, November.
    10. Arne Risa Hole, 2007. "Fitting mixed logit models by using maximum simulated likelihood," Stata Journal, StataCorp LP, vol. 7(3), pages 388-401, September.
    11. Louis Anthony Cox Jr. & Weihsueh A. Chiu & David M. Hassenzahl & Daniel M. Kammen, 2000. "Response," Risk Analysis, John Wiley & Sons, vol. 20(3), pages 295-296, June.
    12. Jae Bong Chang & Jayson L. Lusk, 2011. "Mixed logit models: accuracy and software choice," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 167-172, January/F.
    13. John Calfee & Clifford Winston & Randolph Stempski, 2001. "Econometric Issues In Estimating Consumer Preferences From Stated Preference Data: A Case Study Of The Value Of Automobile Travel Time," The Review of Economics and Statistics, MIT Press, vol. 83(4), pages 699-707, November.
    14. Hess, Stephane & Train, Kenneth E. & Polak, John W., 2006. "On the use of a Modified Latin Hypercube Sampling (MLHS) method in the estimation of a Mixed Logit Model for vehicle choice," Transportation Research Part B: Methodological, Elsevier, vol. 40(2), pages 147-163, February.
    15. Bhat, Chandra R., 2003. "Simulation estimation of mixed discrete choice models using randomized and scrambled Halton sequences," Transportation Research Part B: Methodological, Elsevier, vol. 37(9), pages 837-855, November.
    16. Daniel McFadden & Kenneth Train, 2000. "Mixed MNL models for discrete response," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 447-470.
    17. Hess, Stephane & Rose, John M., 2009. "Allowing for intra-respondent variations in coefficients estimated on repeated choice data," Transportation Research Part B: Methodological, Elsevier, vol. 43(6), pages 708-719, July.
    18. David Hensher & William Greene, 2003. "The Mixed Logit model: The state of practice," Transportation, Springer, vol. 30(2), pages 133-176, May.
    19. Koop, Gary & Pesaran, M. Hashem & Potter, Simon M., 1996. "Impulse response analysis in nonlinear multivariate models," Journal of Econometrics, Elsevier, vol. 74(1), pages 119-147, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maksat Jumamyradov & Murat Munkin & William H. Greene & Benjamin M. Craig, 2024. "Biases in the Maximum Simulated Likelihood Estimation of the Mixed Logit Model," Econometrics, MDPI, vol. 12(2), pages 1-15, March.
    2. De Salvo, Maria & Scarpa, Riccardo & Capitello, Roberta & Begalli, Diego, 2020. "Multi-country stated preferences choice analysis for fresh tomatoes," Bio-based and Applied Economics Journal, Italian Association of Agricultural and Applied Economics (AIEAA), vol. 9(3), December.
    3. Elin Spegel & Kristina Ek, 2022. "Valuing the Impacts of Landslides: A Choice Experiment Approach," Economics of Disasters and Climate Change, Springer, vol. 6(1), pages 163-181, March.
    4. Laura Enthoven & Goedele Van den Broeck, 2021. "Promoting Food Safety in Local Value Chains: The Case of Vegetables in Vietnam," Sustainability, MDPI, vol. 13(12), pages 1-17, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Staus, Alexander, 2008. "Standard and Shuffled Halton Sequences in a Mixed Logit Model," Working Papers 93856, Universitaet Hohenheim, Institute of Agricultural Policy and Agricultural Markets.
    2. Stephane Hess, 2014. "Latent class structures: taste heterogeneity and beyond," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 14, pages 311-330, Edward Elgar Publishing.
    3. Paleti, Rajesh, 2018. "Generalized multinomial probit Model: Accommodating constrained random parameters," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 248-262.
    4. Hess, Stephane & Train, Kenneth E., 2011. "Recovery of inter- and intra-personal heterogeneity using mixed logit models," Transportation Research Part B: Methodological, Elsevier, vol. 45(7), pages 973-990, August.
    5. Haghani, Milad & Bliemer, Michiel C.J. & Hensher, David A., 2021. "The landscape of econometric discrete choice modelling research," Journal of choice modelling, Elsevier, vol. 40(C).
    6. Czajkowski, Mikołaj & Budziński, Wiktor, 2019. "Simulation error in maximum likelihood estimation of discrete choice models," Journal of choice modelling, Elsevier, vol. 31(C), pages 73-85.
    7. Cherchi, Elisabetta & Guevara, Cristian Angelo, 2012. "A Monte Carlo experiment to analyze the curse of dimensionality in estimating random coefficients models with a full variance–covariance matrix," Transportation Research Part B: Methodological, Elsevier, vol. 46(2), pages 321-332.
    8. Campbell, Danny & Hutchinson, W. George & Scarpa, Riccardo, 2006. "Using Discrete Choice Experiments to Derive Individual-Specific WTP Estimates for Landscape Improvements under Agri-Environmental Schemes: Evidence from the Rural Environment Protection Scheme in Irel," Sustainability Indicators and Environmental Valuation Working Papers 12220, Fondazione Eni Enrico Mattei (FEEM).
    9. Zhu, Dianchen & Sze, N.N. & Feng, Zhongxiang & Chan, Ho-Yin, 2023. "Waiting for signalized crossing or walking to footbridge/underpass? Examining the effect of weather using stated choice experiment with panel mixed random regret minimization approach," Transport Policy, Elsevier, vol. 138(C), pages 144-169.
    10. Campbell, Danny & Hutchinson, W. George & Scarpa, Riccardo, 2006. "Lexicographic Preferences in Discrete Choice Experiments: Consequences on Individual-Specific Willingness to Pay Estimates," Sustainability Indicators and Environmental Valuation Working Papers 12224, Fondazione Eni Enrico Mattei (FEEM).
    11. Bliemer, Michiel C.J. & Rose, John M., 2010. "Construction of experimental designs for mixed logit models allowing for correlation across choice observations," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 720-734, July.
    12. Junyi Shen, 2009. "Latent class model or mixed logit model? A comparison by transport mode choice data," Applied Economics, Taylor & Francis Journals, vol. 41(22), pages 2915-2924.
    13. Islam, Mouyid, 2015. "Multi-Vehicle Crashes Involving Large Trucks: A Random Parameter Discrete Outcome Modeling Approach," Journal of the Transportation Research Forum, Transportation Research Forum, vol. 54(1).
    14. Campbell, Danny, 2007. "Combining mixed logit models and random effects models to identify the determinants of willingness to pay for rural landscape improvements," 81st Annual Conference, April 2-4, 2007, Reading University, UK 7975, Agricultural Economics Society.
    15. Danny Campbell & George Hutchinson & Riccardo Scarpa, 2006. "Using mixed logit models to derive individual-specific WTP estimates for landscape improvements under agri-environmental schemes: evidence from the Rural Environment Protection Scheme in Ireland," Working Papers 0607, Rural Economy and Development Programme,Teagasc.
    16. David Hensher & William Greene, 2003. "The Mixed Logit model: The state of practice," Transportation, Springer, vol. 30(2), pages 133-176, May.
    17. Klaus Nowotny, 2011. "Welfare Magnets, Taxation and the Location Decisions of Migrants to the EU," ERSA conference papers ersa11p133, European Regional Science Association.
    18. Klaus Nowotny & Dieter Pennerstorfer, 2011. "Ethnic Networks and the Location Choice of Migrants in Europe," WIFO Working Papers 415, WIFO.
    19. Danny Campbell & George Hutchinson & Riccardo Scarpa, 2006. "Integrating landscape improvement indices and discrete choice experiments: evidence from the Rural Environment Protection Scheme in Ireland," Working Papers 0609, Rural Economy and Development Programme,Teagasc.
    20. Fosgerau, Mogens & Bierlaire, Michel, 2007. "A practical test for the choice of mixing distribution in discrete choice models," Transportation Research Part B: Methodological, Elsevier, vol. 41(7), pages 784-794, August.

    More about this item

    Keywords

    Research Methods/ Statistical Methods;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:aaea16:235990. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/aaeaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.