A RAG Approach for Generating Competency Questions in Ontology Engineering
Date:
Slides Download
I was invited to give a talk about our paper entitled A RAG Approach for Generating Competency Questions in Ontology Engineering at Elsevier office in Amsterdam.
Abstract: Competency Question (CQ) formulation is essential in ontology development but often demands significant effort from domain experts. This study introduces a Retrieval-Augmented Generation (RAG) approach that leverages Large Language Models (LLMs) to automate CQ generation using scientific papers as the domain knowledge base. The research examines how varying the number of input papers and adjusting the LLM’s temperature settings affect performance. Experiments conducted with GPT-4 across two domain ontology tasks reveal that incorporating relevant domain knowledge into the RAG framework enhances CQ generation compared to zero-shot prompting. Evaluation metrics, including precision and consistency, indicate that this method effectively reduces the reliance on manual CQ crafting by domain experts.