In the context of Smart Manufacturing and the Internet of Production, data service discovery plays a central role in enabling cross-organizational collaboration and data-driven innovation. Nevertheless, effective discovery and composition of data services often require deep technical knowledge, limiting the autonomy of domain experts and R&D managers in designing analytics workflows. This paper presents a cooperative approach to data service discovery that combines Large Language Models (LLMs) with Retrieval-Augmented Generation (RAG), leveraging a conceptual model of data services and analytics scenarios. On top of this model, a set of prompting strategies are designed to support different levels of user expertise and interaction goals. These strategies leverage the cooperative nature of the approach, enabling domain experts and R&D managers to incrementally build, extend, and refine analytics data service pipelines through the interaction with LLMs. We describe how these prompting strategies are tightly integrated with the RAG components to inject contextual knowledge derived from a catalog of data services and analytics scenarios. The system is implemented using open-source technologies and evaluated extensively in a real-world smart factory case study. Our evaluation includes both quantitative metrics (precision, recall, faithfulness, factual correctness) and a qualitative user study, demonstrating the effectiveness of prompting strategies and the feasibility of LLM-supported data service discovery in cooperative industrial settings.

Prompting Strategies for LLM-Based Cooperative Data Service Discovery

Bianchini D.
;
Garda M.;Melchiori M.;Rula A.
2026-01-01

Abstract

In the context of Smart Manufacturing and the Internet of Production, data service discovery plays a central role in enabling cross-organizational collaboration and data-driven innovation. Nevertheless, effective discovery and composition of data services often require deep technical knowledge, limiting the autonomy of domain experts and R&D managers in designing analytics workflows. This paper presents a cooperative approach to data service discovery that combines Large Language Models (LLMs) with Retrieval-Augmented Generation (RAG), leveraging a conceptual model of data services and analytics scenarios. On top of this model, a set of prompting strategies are designed to support different levels of user expertise and interaction goals. These strategies leverage the cooperative nature of the approach, enabling domain experts and R&D managers to incrementally build, extend, and refine analytics data service pipelines through the interaction with LLMs. We describe how these prompting strategies are tightly integrated with the RAG components to inject contextual knowledge derived from a catalog of data services and analytics scenarios. The system is implemented using open-source technologies and evaluated extensively in a real-world smart factory case study. Our evaluation includes both quantitative metrics (precision, recall, faithfulness, factual correctness) and a qualitative user study, demonstrating the effectiveness of prompting strategies and the feasibility of LLM-supported data service discovery in cooperative industrial settings.
2026
9783032155375
9783032155382
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11379/640947
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact