Artikel ansehen

In this article, we evaluate the evolution of LLM capabilities wrt the RDF Turtle and SPARQL language as foundational skills to assist with various KGE tasks. We measure the LLM response quality using 6 LLM-KG-Bench tasks for a total of 15 LLM versions available over the course of 2023, covering 5 different” major version” LLM classes (GPT-3.5 Turbo, GPT-4, Claude 1. x, Claude 2. x, and Claude Instant 1. x).