In the context of Smart Manufacturing and the Internet of Production, data service discovery plays a central role in enabling cross-organizational collaboration and data-driven innovation. Nevertheless, effective discovery and composition of data services often require deep technical knowledge, limiting the autonomy of domain experts and R&D managers in designing analytics workflows. This paper presents a cooperative approach to data service discovery that combines Large Language Models (LLMs) with Retrieval-Augmented Generation (RAG), leveraging a conceptual model of data services and analytics scenarios. On top of this model, a set of prompting strategies are designed to support different levels of user expertise and interaction goals. These strategies leverage the cooperative nature of the approach, enabling domain experts and R&D managers to incrementally build, extend, and refine analytics data service pipelines through the interaction with LLMs. We describe how these prompting strategies are tightly integrated with the RAG components to inject contextual knowledge derived from a catalog of data services and analytics scenarios. The system is implemented using open-source technologies and evaluated extensively in a real-world smart factory case study. Our evaluation includes both quantitative metrics (precision, recall, faithfulness, factual correctness) and a qualitative user study, demonstrating the effectiveness of prompting strategies and the feasibility of LLM-supported data service discovery in cooperative industrial settings.

Prompting Strategies for LLM-Based Cooperative Data Service Discovery

Bianchini D.
;
Garda M.;Melchiori M.;Rula A.
2026-01-01

Abstract

In the context of Smart Manufacturing and the Internet of Production, data service discovery plays a central role in enabling cross-organizational collaboration and data-driven innovation. Nevertheless, effective discovery and composition of data services often require deep technical knowledge, limiting the autonomy of domain experts and R&D managers in designing analytics workflows. This paper presents a cooperative approach to data service discovery that combines Large Language Models (LLMs) with Retrieval-Augmented Generation (RAG), leveraging a conceptual model of data services and analytics scenarios. On top of this model, a set of prompting strategies are designed to support different levels of user expertise and interaction goals. These strategies leverage the cooperative nature of the approach, enabling domain experts and R&D managers to incrementally build, extend, and refine analytics data service pipelines through the interaction with LLMs. We describe how these prompting strategies are tightly integrated with the RAG components to inject contextual knowledge derived from a catalog of data services and analytics scenarios. The system is implemented using open-source technologies and evaluated extensively in a real-world smart factory case study. Our evaluation includes both quantitative metrics (precision, recall, faithfulness, factual correctness) and a qualitative user study, demonstrating the effectiveness of prompting strategies and the feasibility of LLM-supported data service discovery in cooperative industrial settings.
2026
Lecture Notes in Computer Science
MIUR (compresi PRIN FIRB,FISR)
PE6_10 Web and information systems, database systems, information retrieval and digital libraries
Inglese
no
31st International Conference on Cooperative Information Systems, CoopIS 2025
2025
Marbella, Spagna
Internazionale
ELETTRONICO
15535
163
180
18
9783032155375
9783032155382
Springer Science and Business Media Deutschland GmbH
Data Service Discovery; Large Language Models; Prompt Engineering; Retrieval-Augmented Generation
no
Goal 9: Industry, Innovation, and Infrastructure
none
Bianchini, D.; Garda, M.; Melchiori, M.; Rula, A.
273
info:eu-repo/semantics/conferenceObject
4
4 Contributo in Atti di Convegno (Proceeding)::4.1 Contributo in Atti di convegno
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11379/640947
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact