In the last decade, the major private IT companies have developed lots of cloud platforms for Natural Language Understanding (NLU), that are widely used for research and commercial purposes. One of the main reasons for the success of NLU platforms is because they allow to simplify the Chatbots or Spoken Dialogue Systems (SDS) development and, in many cases, without knowledge about programming languages. In this paper, we present a general description and a taxonomy that brings together features and constraints of different cloud-based NLU services available on the market. Furthermore, we provide an evaluation and a comparison concerning the ability to recognise the underlying intents of different sentences. The sentences used are a collection of requests made by users in Italian on an e-learning platform. This analysis wants to help the company, owner of the e-learning platform, to understand in which NLU platform it is better to build a chatbot for the Italian language aiming at answering the most frequently asked questions.

Evaluating different Natural Language Understanding services in a real business case for the Italian language

Zubani, Matteo
;
Serina, Ivan;Gerevini, Alfonso Emilio
2020-01-01

Abstract

In the last decade, the major private IT companies have developed lots of cloud platforms for Natural Language Understanding (NLU), that are widely used for research and commercial purposes. One of the main reasons for the success of NLU platforms is because they allow to simplify the Chatbots or Spoken Dialogue Systems (SDS) development and, in many cases, without knowledge about programming languages. In this paper, we present a general description and a taxonomy that brings together features and constraints of different cloud-based NLU services available on the market. Furthermore, we provide an evaluation and a comparison concerning the ability to recognise the underlying intents of different sentences. The sentences used are a collection of requests made by users in Italian on an e-learning platform. This analysis wants to help the company, owner of the e-learning platform, to understand in which NLU platform it is better to build a chatbot for the Italian language aiming at answering the most frequently asked questions.
File in questo prodotto:
File Dimensione Formato  
1-s2.0-S1877050920319955-main.pdf

accesso aperto

Tipologia: Documento in Post-print
Licenza: PUBBLICO - Creative Commons 4.0
Dimensione 526.55 kB
Formato Adobe PDF
526.55 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11379/535075
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 8
  • ???jsp.display-item.citation.isi??? ND
social impact