In this paper we consider the problem of the evaluation of undergraduate and graduate courses, in the context of Italian universities. We present a descriptive measure of ordinal inter-rater agreement that can be associated with a suitable index of satisfaction. This measure is a modification of a previously proposed index, which avoids the problem of paradoxes of both Cohen’s and Fleiss’ kappa statistics. We apply our results to the evaluation of the Bachelors and Masters of Sciences in Economics at the University of Milan-Bicocca.

The ordinal inter-rater agreement in the evaluation of University courses

MARASINI, DONATA;RIPAMONTI, ENRICO
2014-01-01

Abstract

In this paper we consider the problem of the evaluation of undergraduate and graduate courses, in the context of Italian universities. We present a descriptive measure of ordinal inter-rater agreement that can be associated with a suitable index of satisfaction. This measure is a modification of a previously proposed index, which avoids the problem of paradoxes of both Cohen’s and Fleiss’ kappa statistics. We apply our results to the evaluation of the Bachelors and Masters of Sciences in Economics at the University of Milan-Bicocca.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11379/545729
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? ND
social impact