publication . Article . Part of book or chapter of book . 2011

Ontology Alignment Evaluation Initiative: six years of experience

Jérôme Euzenat; Christian Meilicke; Heiner Stuckenschmidt; Pavel Shvaiko; Cassia Trojahn;
Open Access English
  • Published: 08 Aug 2011
  • Publisher: HAL CCSD
  • Country: France
Abstract
euzenat2011b; International audience; In the area of semantic technologies, benchmarking and systematic evaluation is not yet as established as in other areas of computer science, e.g., information retrieval. In spite of successful attempts, more effort and experience are required in order to achieve such a level of maturity. In this paper, we report results and lessons learned from the Ontology Alignment Evaluation Initiative (OAEI), a benchmarking initiative for ontology matching. The goal of this work is twofold: on the one hand, we document the state of the art in evaluating ontology matching methods and provide potential participants of the initiative with ...
Persistent Identifiers
Subjects
free text keywords: Evaluation, Experimentation, Benchmarking, Ontology matching, Ontology alignment, Schema matching, Semantic technologies, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], [INFO.INFO-WB]Computer Science [cs]/Web, Semantic technology, Ontology-based data integration, Data science, Ontology alignment, Ontology (information science), Schema matching, Benchmarking, Process ontology, Knowledge management, business.industry, business, Computer science, Upper ontology
Funded by
EC| SEALS
Project
SEALS
Semantic Evaluation at Large Scale
  • Funder: European Commission (EC)
  • Project Code: 238975
  • Funding stream: FP7 | SP4 | INFRA

1. Bogdan Alexe, Wang Chiew Tan, and Yannis Velegrakis. Comparing and evaluating mapping systems with STBenchmark. VLDB Endowment (PVLDB), 1(2):1468-1471, 2008.

2. Bogdan Alexe, Wang Chiew Tan, and Yannis Velegrakis. Stbenchmark: towards a benchmark for mapping systems. VLDB Endowment (PVLDB), 1(1):230-244, 2008.

3. David Aumueller, Hong-Hai Do, Sabine Massmann, and Erhard Rahm. Schema and ontology matching with COMA++. In Proceedings of the 24th International Conference on Management of Data (SIGMOD), Software Demonstration, pages 906-908, Baltimore (MD US), June 2005.

4. Tim Berners-Lee, James Hendler, and Ora Lassila. The semantic web. Scientific American, 284(5):34-43, 2001.

5. Philip Bernstein, Alon Halevy, and Rachel Pottinger. A vision of management of complex models. ACM SIGMOD Record, 29(4):55-63, 2000.

6. Christian Bizer and Andreas Schultz. The berlin SPARQL benchmark. International Journal of Semantic Web and Information Systems, 5(2):1-24, 2009.

7. Paolo Bouquet, Marc Ehrig, Jérôme Euzenat, Enrico Franconi, Pascal Hitzler, Markus Krotzsch, Luciano Serafini, Giorgios Stamou, York Sure, and Sergio Tessaris. Specification of a common framework for characterizing alignment. Deliverable D2.2.1v2, Knowledge web NoE, December 2004.

8. Caterina Caracciolo, Jérôme Euzenat, Laura Hollink, Ryutaro Ichise, Antoine Isaac, Véronique Malaisé, Christian Meilicke, Juan Pane, Pavel Shvaiko, Heiner Stuckenschmidt, Ondrˇej Šváb Zamazal, and Vojtech Svatek. Results of the ontology alignment evaluation initiative 2008. In Proceedings of the ISWC 2008 Workshop on Ontology Matching, pages 73-119, Karlsruhe (DE), October 2007.

9. Raúl García Castro, Diana Maynard, Doug Foxvog, Holger Wache, and Rafael GonzálezCabero. Specification of a methodology, general criteria, and benchmark suites for benchmarking ontology tools. Deliverable D2.1.4, Knowledge web NoE, February 2004.

10. Isabel Cruz, Flavio Palandri Antonelli, and Cosmin Stroe. Agreementmaker: efficient matching for large real-world schemas and ontologies. VLDB Endowment, 2(2):1586-1589, 2009.

11. Isabel Cruz, Flavio Palandri Antonelli, Cosmin Stroe, Ulas C. Keles, and Angela Maduko. Using AgreementMaker to align ontologies for OAEI 2009: Overview, results, and outlook. In Proceedings of the ISWC 2009 Workshop on Ontology Matching, pages 135-146, October 2009.

12. Isabel F. Cruz, Flavio Palandri Antonelli, and Cosmin Stroe. Agreementmaker: Efficient matching for large real-world schemas and ontologies. VLDB Endowment (PVLDB), 2(2):1586-1589, 2009.

13. Jérôme David. AROMA results for OAEI 2009. In Proceedings of the ISWC 2009 Workshop on Ontology Matching, pages 147-151, October 2009.

14. Jérôme David, Jérôme Euzenat, François Scharffe, and Cássia Trojahn. The Alignment API 4.0. Semantic web journal, 2(1), 2011.

Abstract
euzenat2011b; International audience; In the area of semantic technologies, benchmarking and systematic evaluation is not yet as established as in other areas of computer science, e.g., information retrieval. In spite of successful attempts, more effort and experience are required in order to achieve such a level of maturity. In this paper, we report results and lessons learned from the Ontology Alignment Evaluation Initiative (OAEI), a benchmarking initiative for ontology matching. The goal of this work is twofold: on the one hand, we document the state of the art in evaluating ontology matching methods and provide potential participants of the initiative with ...
Persistent Identifiers
Subjects
free text keywords: Evaluation, Experimentation, Benchmarking, Ontology matching, Ontology alignment, Schema matching, Semantic technologies, [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI], [INFO.INFO-WB]Computer Science [cs]/Web, Semantic technology, Ontology-based data integration, Data science, Ontology alignment, Ontology (information science), Schema matching, Benchmarking, Process ontology, Knowledge management, business.industry, business, Computer science, Upper ontology
Funded by
EC| SEALS
Project
SEALS
Semantic Evaluation at Large Scale
  • Funder: European Commission (EC)
  • Project Code: 238975
  • Funding stream: FP7 | SP4 | INFRA

1. Bogdan Alexe, Wang Chiew Tan, and Yannis Velegrakis. Comparing and evaluating mapping systems with STBenchmark. VLDB Endowment (PVLDB), 1(2):1468-1471, 2008.

2. Bogdan Alexe, Wang Chiew Tan, and Yannis Velegrakis. Stbenchmark: towards a benchmark for mapping systems. VLDB Endowment (PVLDB), 1(1):230-244, 2008.

3. David Aumueller, Hong-Hai Do, Sabine Massmann, and Erhard Rahm. Schema and ontology matching with COMA++. In Proceedings of the 24th International Conference on Management of Data (SIGMOD), Software Demonstration, pages 906-908, Baltimore (MD US), June 2005.

4. Tim Berners-Lee, James Hendler, and Ora Lassila. The semantic web. Scientific American, 284(5):34-43, 2001.

5. Philip Bernstein, Alon Halevy, and Rachel Pottinger. A vision of management of complex models. ACM SIGMOD Record, 29(4):55-63, 2000.

6. Christian Bizer and Andreas Schultz. The berlin SPARQL benchmark. International Journal of Semantic Web and Information Systems, 5(2):1-24, 2009.

7. Paolo Bouquet, Marc Ehrig, Jérôme Euzenat, Enrico Franconi, Pascal Hitzler, Markus Krotzsch, Luciano Serafini, Giorgios Stamou, York Sure, and Sergio Tessaris. Specification of a common framework for characterizing alignment. Deliverable D2.2.1v2, Knowledge web NoE, December 2004.

8. Caterina Caracciolo, Jérôme Euzenat, Laura Hollink, Ryutaro Ichise, Antoine Isaac, Véronique Malaisé, Christian Meilicke, Juan Pane, Pavel Shvaiko, Heiner Stuckenschmidt, Ondrˇej Šváb Zamazal, and Vojtech Svatek. Results of the ontology alignment evaluation initiative 2008. In Proceedings of the ISWC 2008 Workshop on Ontology Matching, pages 73-119, Karlsruhe (DE), October 2007.

9. Raúl García Castro, Diana Maynard, Doug Foxvog, Holger Wache, and Rafael GonzálezCabero. Specification of a methodology, general criteria, and benchmark suites for benchmarking ontology tools. Deliverable D2.1.4, Knowledge web NoE, February 2004.

10. Isabel Cruz, Flavio Palandri Antonelli, and Cosmin Stroe. Agreementmaker: efficient matching for large real-world schemas and ontologies. VLDB Endowment, 2(2):1586-1589, 2009.

11. Isabel Cruz, Flavio Palandri Antonelli, Cosmin Stroe, Ulas C. Keles, and Angela Maduko. Using AgreementMaker to align ontologies for OAEI 2009: Overview, results, and outlook. In Proceedings of the ISWC 2009 Workshop on Ontology Matching, pages 135-146, October 2009.

12. Isabel F. Cruz, Flavio Palandri Antonelli, and Cosmin Stroe. Agreementmaker: Efficient matching for large real-world schemas and ontologies. VLDB Endowment (PVLDB), 2(2):1586-1589, 2009.

13. Jérôme David. AROMA results for OAEI 2009. In Proceedings of the ISWC 2009 Workshop on Ontology Matching, pages 147-151, October 2009.

14. Jérôme David, Jérôme Euzenat, François Scharffe, and Cássia Trojahn. The Alignment API 4.0. Semantic web journal, 2(1), 2011.

Any information missing or wrong?Report an Issue