Séminaires RALI-OLST

Leveraging Distant Supervision for Word Representations

Abbas Ghaddar (abbassgh_1993 <at> hotmail (point) com)

RALI, DIRO

Tuesday 10 April 2018 at 9:30 AM  — !!! date inhabituelle ET HEURE !!!

Salle 3195, Pavillon André-Aisenstadt


The small amount of annotated data in Natural Language Processing (NLP) have tied the learning of high quality word representations to unsupervised tasks like context prediction and language modeling. The main reason behind this is the absence of largescale manually labelled data for most NLP tasks. Distant supervision techniques are very promising as they can be used to overcome the lack of large-scale labelled data in NLP applications. Although models trained on distant supervision data improve general domain performances, they perform poorly in domain-specific evaluations. Therefor, we propose to leverage distant supervision in order to learn word representations that can be used latter as features. We argue that, if massive amount of labelled data is available, good representations could be learn on downstream supervised tasks (like entity typing and relation extraction). To the best of our knowledge, this exact subject has not been yet explored, consequently we will tackle it in our research. While analyzing future direction of our research, we identified two main tasks : (1) Generate large-scale of labelled data following distant supervision approaches. Our main objective is to gather as much as possible of annotations, while introducing as less or as possible the minimum portion of noise. (2) Leveraging the massive amount of distant supervision data to learn word representations via supervised tasks. We will focus on three downstream tasks : Named Entity Recognition, Fine Grained Entity Typing and Relation Extraction. Our preliminary experimental results show that representations learnt with distant supervision data are complementary to those by other methods.



Join with Zoom at this url.
Meeting ID: 916 9097 5818, 𝑷𝒂𝒔𝒔𝒄𝒐𝒅𝒆: 343273.
Phone numbers: https://umontreal.zoom.us/u/abitNZzLg.
One tap mobile: +14388097799,,91690975818#,,,,,,0#,,343273#


To receive weekly talk announcements, please send an e-mail to majordomo@iro.umontreal.ca. Simply write a message containing the single line 'subscribe ralli' (without the quotes).

See all the weekly talks for the year:

1991 1992 1993 1994 1995 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021