Evaluation of Distributional Semantic Models of Ancient Greek: Preliminary Results and a Road Map for Future Work

Silvia Stopponi, Nilo Pedrazzini, Saskia Peels, Barbara McGillivray, Malvina Nissim

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review

26 Downloads (Pure)

Abstract

We evaluate four count-based and predictive distributional semantic models of Ancient Greek against AGREE, a composite benchmark of human judgements, to assess their ability to retrieve semantic relatedness. On the basis of the observations deriving from the analysis of the results, we design a procedure for a larger-scale intrinsic evaluation of count-based and predictive language models, including syntactic embeddings. We also propose possible ways of exploiting the different layers of the whole AGREE benchmark (including both human- and machine-generated data) and different evaluation metrics.
Original languageEnglish
Title of host publicationProceedings of the 1st International Workshop on Ancient Language Processing (ALP) at RANLP
PublisherINCOMA Ltd., Shoumen, Bulgaria
Pages49–58
Publication statusE-pub ahead of print - Sept 2023

Fingerprint

Dive into the research topics of 'Evaluation of Distributional Semantic Models of Ancient Greek: Preliminary Results and a Road Map for Future Work'. Together they form a unique fingerprint.

Cite this