The analysis of human perceptions is often carried out by resorting to surveys and questionnaires, where respondents are asked to express ratings about the objects being evaluated. A class of mixture models, called CUB (Combination of Uniform and shifted Binomial), has been recently proposed in this context. This paper focuses on a model of this class, the Nonlinear CUB, and investigates some computational issues concerning parameter estimation, which is performed by Maximum Likelihood. More specifically, we consider two main approaches to optimize the log-likelihood: the classical numerical methods of optimization and the EM algorithm. The classical numerical methods comprise the widely used algorithms Nelder-Mead, Newton-Raphson, Broyden-Fletcher-Goldfarb-Shanno (BFGS), Berndt-Hall-Hall-Hausman (BHHH), Simulated Annealing, Conjugate Gradients and usually have the advantage of a fast convergence. On the other hand, the EM algorithm deserves consideration for some optimality properties in the case of mixture models, but it is slower. This paper has a twofold aim: firstly we show how to obtain explicit formulas for the implementation of the EM algorithm in Nonlinear CUB models and we formally derive the asymptotic variance-covariance matrix of the Maximum Likelihood estimator; secondly we discuss and compare the performance of the two above mentioned approaches to the log-likelihood maximization.

Estimation of Nonlinear CUB models via numerical optimization and EM algorithm

MANISERA, Marica;ZUCCOLOTTO, Paola
2017-01-01

Abstract

The analysis of human perceptions is often carried out by resorting to surveys and questionnaires, where respondents are asked to express ratings about the objects being evaluated. A class of mixture models, called CUB (Combination of Uniform and shifted Binomial), has been recently proposed in this context. This paper focuses on a model of this class, the Nonlinear CUB, and investigates some computational issues concerning parameter estimation, which is performed by Maximum Likelihood. More specifically, we consider two main approaches to optimize the log-likelihood: the classical numerical methods of optimization and the EM algorithm. The classical numerical methods comprise the widely used algorithms Nelder-Mead, Newton-Raphson, Broyden-Fletcher-Goldfarb-Shanno (BFGS), Berndt-Hall-Hall-Hausman (BHHH), Simulated Annealing, Conjugate Gradients and usually have the advantage of a fast convergence. On the other hand, the EM algorithm deserves consideration for some optimality properties in the case of mixture models, but it is slower. This paper has a twofold aim: firstly we show how to obtain explicit formulas for the implementation of the EM algorithm in Nonlinear CUB models and we formally derive the asymptotic variance-covariance matrix of the Maximum Likelihood estimator; secondly we discuss and compare the performance of the two above mentioned approaches to the log-likelihood maximization.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11379/484455
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 3
social impact