Abstract
OWL and RDF/RDFS are ontological languages developed by the World Wide Web Consortium (W3), which have become a de facto standard for the ontological descriptions in various domains. The evolution of these standards was influenced by the numerous advances in the research of knowledge representation and reasoning. Although support for reasoning and standardized representation is the key benefit of these technologies, there is a lack of existing test frameworks, which would be capable of addressing many crucial aspects of the Semantic Web applications.
In this paper we propose a methodology for automated testing of OWL reasoners based on the real-world ontologies. This specification covers both terminological and assertional reasoning as well as checking of the correctness of the answers. An open-source implementation of such framework is described and a study of initial results is provided. The tests cover an extensive set of reasoners and ontologies and provide a state-of-the-art insight into the field of OWL reasoning.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Borgida, A., Brachman, R.J., McGuinness, D.L., Resnick, L.A.: CLASSIC: a structural data model for objects. In: SIGMOD 1989: Proceedings of the 1989 ACM SIGMOD international conference on Management of data, pp. 58–67. ACM, New York (1989)
Guo, Y., Pan, Z., Heflin, J.: Lubm: A benchmark for owl knowledge base systems. J. Web Sem. 3(2-3), 158–182 (2005)
Haarslev, V., Möller, R.: Description of the racer system and its applications. In: Proceedings International Workshop on Description Logics (DL 2001), Stanford, USA, August 1-3, pp. 131–141 (2001)
Horrocks, I.: The FaCT system. In: de Swart, H. (ed.) TABLEAUX 1998. LNCS, vol. 1397, pp. 307–350. Springer, Heidelberg (1998)
Horrocks, I., Patel-Schneider, P.F.: Dl systems comparison (summary relation). In: Franconi, E., De Giacomo, G., MacGregor, R.M., Nutt, W., Welty, C.A. (eds.) Description Logics. CEUR Workshop Proceedings, CEUR-WS.org , vol. 11 (1998)
Hustadt, U., Motik, B., Sattler, U.: Reasoning for Description Logics around SHIQ in a Resolution Framework. Technical Report 3-8-04/04, FZI, Germany (2004)
K-Wf Grid. K-Wf Grid technical annex (2004), http://www.kwfgrid.net
Kiryakov, A., Ognyanov, D., Manov, D.: OWLIM a pragmatic semantic repository for owl. In: Web Information Systems Engineering WISE 2005 Workshops, pp. 182–192. IEEE Computer Society, Los Alamitos (2005)
Lee, B.T., Hendler, J., Lassila, O.: The semantic web. Scientific American (May 2001)
MacGregor, R.M.: Inside the LOOM description classifier. SIGART Bull. 2(3), 88–92 (1991)
Massacci, F., Donini, F.M.: Design and results of tancs-2000 non-classical (modal) systems comparison. In: Dyckhoff, R. (ed.) TABLEAUX 2000. LNCS, vol. 1847, pp. 52–56. Springer, Heidelberg (2000)
Motik, B., Shearer, R., Horrocks, I.: Optimized reasoning in description logics using hypertableaux. In: Pfenning, F. (ed.) CADE 2007. LNCS, vol. 4603, pp. 67–83. Springer, Heidelberg (2007)
Pan, Z.: Benchmarking dl reasoners using realistic ontologies. In: Proceedings of the OWL: Experiences and Directions Workshop. Galway (2005)
Patel-Schneider, P.F.: DLP system description. In: McAllester, D. (ed.) CADE 2000. LNCS, vol. 1831, pp. 297–301. Springer, Heidelberg (2000)
Sirin, E., Parsia, B., Grau, B.C., Kalyanpur, A., Katz, Y.: Pellet: a practical OWL-DL reasoner. Journal of Web Semantics 5(2), 51–53 (2007)
Horrocks, I., Gardiner, T., Tsarkov, D.: Framework for an automated comparison of description logic reasoners. In: Cruz, I., Decker, S., Allemang, D., Preist, C., Schwabe, D., Mika, P., Uschold, M., Aroyo, L.M. (eds.) ISWC 2006. LNCS, vol. 4273, pp. 654–667. Springer, Heidelberg (2006)
Wang, T.D., Parsia, B., Hendler, J.A.: A survey of the web ontology landscape. In: International Semantic Web Conference, pp. 682–694 (2006)
Weithöner, T., Liebig, T., Luther, M., Böhm, S., von Henke, F.W., Noppens, O.: Real-world reasoning with owl. In: Franconi, E., Kifer, M., May, W. (eds.) ESWC 2007. LNCS, vol. 4519, pp. 296–310. Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Babik, M., Hluchy, L. (2008). On Automated Testing of Description Logic Reasoners. In: Parashar, M., Aggarwal, S.K. (eds) Distributed Computing and Internet Technology. ICDCIT 2008. Lecture Notes in Computer Science, vol 5375. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89737-8_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-89737-8_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-89736-1
Online ISBN: 978-3-540-89737-8
eBook Packages: Computer ScienceComputer Science (R0)