Information Systems Group

― Knowledge Representation and Reasoning

SEALS - Semantic Evaluation at Large Scale

A FP-7 Collaborative Project and Coordination and Support Action - Integrated Infrastructure Initiative (I3) in Knowledge Representation and Reasoning


Semantic technologies are at the heart of the future Web providing ways to express knowledge and data so that it can be properly exploited. These technologies will empower a new class of Information and Communication Technologies much more scalable, interoperable, and with a higher degree of process automation.

The goal of the SEALS project is to provide an independent, open, scalable, extensible and sustainable infrastructure (the SEALS Platform) that allows the remote evaluation of semantic technologies thereby providing an objective comparison of the different existing semantic technologies. This will allow researchers and users to effectively compare the available technologies, helping them to select appropriate technologies and advancing the state of the art through continuous evaluation.

The SEALS Platform will provide an integrated set of semantic technology evaluation services and test suites. They will be used in two public and worldwide evaluation campaigns. The results of these evaluation campaigns will be used to create semantic technology roadmaps identifying sets of efficient and compatible tools for developing large-scale semantic applications.

The semantic technology evaluation services will initially be available for five different types of technologies (ontology engineering tools, storage and reasoning systems, matching tools, semantic search tools, and semantic web service tools) and for different evaluation criteria (interoperability, scalability, etc.). The platform will provide easy and free access to the evaluation services and to the results of the evaluations performed.

ISG team leads work package "Storage and Reasoning Systems" intended to provide evaluation services and data for the systems that store knowledge (data and ontologies) answer queries about this knowledge, and draw inferences from this knowledge.


SEALS project received funding from the European Union's Seventh Framework Programm for research, technological development and demonstration.

Project Summary


June 2009 to May 2012


Ian Horrocks, Giorgos Stoilos, and Mikalai Yatskevich


Seventh Framework Programme (FP-7)


SEALS project

Key Publications

Giorgos Stoilos, Bernardo Cuenca Grau, and Ian Horrocks. How Incomplete is your Semantic Web Reasoner? In Proc. of the 20th Nat. Conf. on Artificial Intelligence (AAAI 10), pages 1431-1436. AAAI Publications, 2010.
[ bib | .pdf ]

Giorgos Stoilos, Bernardo Cuenca Grau, and Ian Horrocks. Completeness Guarantees for Incomplete Reasoners. In Proc. of the 9th International Semantic Web Conference (ISWC 2010), 2010.
[ bib | .pdf ]