Report of CE on Semantic DS

This document reports on the core experiment on the Semantic DS [5]. The Semantic DS allows describing the world depicted by the AV content and interpreting that world, i.e., the “about” of the AV content or depicted narrative reality, which sometimes is imaginary. The CE originally started at the Maui meeting in December 1999 [4]. Progress reports of the CE were provided at the Geneva meeting [1], at the Beijing meeting [3], and at the La Baule meeting [2]. In La Baule, some components of the Semantic DS were promoted to the WD - Semantic DS, SemanticBase DS, Object DS, Event DS, AgentObject DS, SemanticPlace DS, SemanticTime DS, MediaOccurrence DS, and semantic relations-, and others were promoted to the XM – SemanticState DS, Concept DS, and AbstractionLevel datatype. The goal of this CE is to continue the refinement and evaluation of the Semantic DS and to continue the evaluation of the use of membership functions to describe relation strength. The AbstractionLevel datatype was promoted to CD before Pisa. At Pisa, the work to update the specification of the the SemanticTime, SemanticPlace, and Event DSs and to explain the methods for abstraction and the use of abstract concepts was started. The main tasks of this core experiment have been the following: 1. To refine the specification of the Semantic DS by solving open issues identified by reviewers and previous CEs; 2. To recommend the standardization of more semantic relations; 3. To continue the investigation of the use of membership functions to describe the strength of relations; 4. To generate simple and complex semantic descriptions of multimedia material, 5. To continue the implementation of a retrieval and browsing application/s that use/s the generated descriptions and that show/s the functionality of the DSs in the MDS XM, and 6. To recommend changes and additions to the Semantic DS based on the results of the experiment. The retrieval application that the CE continued the development of the software that had already been integrated into the XM for the Semantic DS.