A Hohfeldian Knowledge Base for LLM-Assisted Legal Information Retrieval in Marine Biodiversity Law

Research output: Chapter in Book/Report/Conference proceedingChapterAcademic

4 Downloads (Pure)

Abstract

Governance of marine genetic resources is fragmented across overlapping treaties, creating uncertainty about which obligations apply in specific situations. We address this by mapping treaty provisions into a normative structure based on Hohfelds framework, the Hohfeld-Structured Normative Knowledge Base (HSNKB), and by constructing a dataset of 15 fact-pattern questions with expert gold answers. We evaluate four recent large language models (LLMs) on retrieving rows that contain the relevant rules to answer the fact-pattern questions. The results indicate that reasoning LLMs achieved modest precision and middling recall. Hohfeldian representations help avoid false positives, but improving recall without degrading precision remains an open problem for cross-treaty retrieval.
Original languageEnglish
Title of host publicationLegal Knowledge and Information Systems
EditorsRéka Markovich, Luigi Di Caro, Claudio Schifanella
Place of PublicationAmsterdam
PublisherIOS Press
Pages318-323
DOIs
Publication statusPublished - 2 Dec 2025

Publication series

SeriesFrontiers in Artificial Intelligence and Applications
Volume416
ISSN0922-6389

Fingerprint

Dive into the research topics of 'A Hohfeldian Knowledge Base for LLM-Assisted Legal Information Retrieval in Marine Biodiversity Law'. Together they form a unique fingerprint.

Cite this