Séminaires RALI-OLST

Towards More Effective and Efficient Long-Text Machine Reading Comprehension - Présentation prédoc 3

Suyuchen Wang (suyuchen (point) wang <at> umontreal (point) ca)


Le mercredi 14 décembre 2022 à 11 h 30

Réunion Zoom, ci-dessous — Virtual presentation

Long-text machine reading comprehension (LT-MRC) requires the machine to answer questions based on a lengthy text, such as stories, academic papers, and books. Although machine reading comprehension (MRC) has been one of the cutting-edge research fields in natural language processing, MRC on long documents poses several extra challenges to the model, which requires a more effective discovery and modeling of distant concept dependencies and more efficient training methods and architectures to decrease Transformer's $O(n^2)$ time complexity for longer inputs. In this talk, we present three directions toward building a better LT-MRC system. For more effective concept dependency modeling, we introduce HEF and QEN, which are state-of-the-art taxonomy expansion and completion models that can build hierarchical knowledge graphs based on concept-describing text pieces to assist graph-based MRC approaches. We also introduce two ongoing projects which improve PLM's focus on both the document and question to generate answers more related to the given context, and an improvement to the latest global convolutional models to allow learnable, flexible, and adaptive distant dependency modeling with lower time complexity than Transformers. For future works, we would like to investigate more efficient architectures for longer inputs, and better utilizing layouts to improve LT-MRC models.

Joignez-vous à nous avec Zoom à l'aide de cette URL.
ID de réunion : 916 9097 5818, Code : 343273.
Numéros de téléphone : https://umontreal.zoom.us/u/abitNZzLg.
One tap mobile : +14388097799,,91690975818#,,,,,,0#,,343273#

Pour recevoir les annonces hebdomadaires par courriel, envoyez un message à l'adresse majordomo@iro.umontreal.ca. Il suffit d'envoyer un message ne contenant que la ligne 'subscribe ralli' (sans les apostrophes, avec un double 'l' dans 'ralli').

Liste de tous les séminaires pour l'année :

1991 1992 1993 1994 1995 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023