A Comparison of Methods for Identifying the Translation of Words in a Comparable Corpus: Recipes and Limits
Wednesday 24 February 2016 at 11:30 AM
C-2059 - Pavillon Lionel-Groulx / Carrefour des arts et des sciences — Endroit inhabituel - Salle de vidéoconférence
Identifying translations in comparable corpora is a challenge that has attracted many researchers since a long time. It has applications in several fields including Machine Translation and Cross-lingual Information Retrieval. In this study we compare three state-of-the-art approaches for these tasks: the so-called context-based projection method, the projection of the word embedding, as well as a method dedicated to identify translation of rare words. We carefully explore the meta-parameters of each method and measure their impact on the task of identifying the translation of English words in Wikipedia into French.
Contrary to the standard practice, we designed a test case where we do not resort to heuristics in order to pre-select the target vocabulary among which to find the translation, therefore pushing each method to its limit. We show that all the approaches we tested have a clear biased toward frequent words. In fact, the best approach we tested could identify the translation of a third of a set of frequent test words, while it could only translate around 10% of rare words. In the end, we show that the union of the three approaches yields the best results, thus demonstrating their complementarity.
Follow this link to subscribe to future RALI-OLST announcements.
See all the weekly talks for the year:1991 1992 1993 1994 1995 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024