Multi-source entity resolution for genealogical data

J. Efremova, Bijan Ranjbar-Sahraei, H. Rahmani, F. Oliehoek, T. Calders, K. Tuyls, G. Weiss

Research output: Chapter in Book/Report/Conference proceedingChapterAcademic

Abstract

In this chapter, we study the application of existing entity resolution (er) techniques on a real-world multi-source genealogical dataset. Our goal is to identify all persons involved in various notary acts and link them to their birth, marriage, and death certificates. We analyze the influence of additional er features, such as name popularity, geographical distance, and co-reference information on the overall er performance. We study two prediction models: regression trees and logistic regression. In order to evaluate the performance of the applied algorithms and to obtain a training set for learning the models we developed an interactive interface for getting feedback from human experts. We perform an empirical evaluation on the manually annotated dataset in terms of precision, recall, and f-score. We show that using name popularity, geographical distance together with co-reference information helps to significantly improve er results.keywordsdeath certificateentity resolutionentity resolutioncandidate pairnatural language processing techniquegenealogical datathese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Original languageEnglish
Title of host publicationPopulation reconstruction
EditorsG. Boothooft, P. Christen, K. Mandemakers, M. Schraagen
PublisherSpringer Verlag
Pages129-154
Number of pages26
DOIs
Publication statusPublished - 2015

Cite this