4 papers
The CitizenQuery Benchmark: A Novel Dataset and Evaluation Pipeline for Measuring LLM Performance in Citizen Query Tasks
Neil Majithia, Rajat Shinde, Zo Chapman +5
"Citizen queries" are questions asked by an individual about government policies, guidance, and services that are relevant to their circumstances, encompassing a range of topics in…
Knowledge Prompting: How Knowledge Engineers Use Large Language Models
Elisavet Koutsiana, Johanna Walker, Michelle Nwachukwu +3
Despite many advances in knowledge engineering (KE), challenges remain in areas such as engineering knowledge graphs (KGs) at scale, keeping up with evolving domain knowledge, mult…
Keywords are not always the key: A metadata field analysis for natural language search on open data portals
Lisa-Yao Gan, Arunav Das, Johanna Walker +1
Open data portals are essential for providing public access to open datasets. However, their search interfaces typically rely on keyword-based mechanisms and a narrow set of metada…
Methods to Assess the UK Government's Current Role as a Data Provider for AI
Neil Majithia, Elena Simperl
Governments typically collect and steward a vast amount of high-quality data on their citizens and institutions, and the UK government is exploring how it can better publish and pr…