Séminaires RALI-OLST

L'augmentation de données est morte, longue vie à l'augmentation de données

Frédéric Piedboeuf (fred (point) piedboeuf <at> gmail (point) com)

RALI, DIRO

Le mercredi 28 février 2024 à 11 h 30

Salle C-9019, Pavillon Lionel-Groulx — Diffusion simultanée sur Zoom


Textual data augmentation is a prolific field of study where novel techniques to create artificial data are regularly proposed. For the text classification task, it is accepted that the possible gains depend greatly on the size of the dataset, with larger gains being associated to smaller datasets. In this paper, we challenge those results, showing that data augmentation is simply a way of performing better fine-tuning on the neural networks, and that spending more time fine-tuning before applying data augmentation negates its effect. This is a significant contribution as it answers several questions that were left open in recent years, namely: what DA technique performs best (all of them as long as they generate data close enough to the training set) and why does DA work (facilitate training of network). We furthermore show that zero shot data generation via conversational agents such as ChatGPT or LLama2 can increase the performance, but not as much as collecting and annotating external data.

La présentation sera en français.

Enregistrement: https://umontreal.ca.panopto.com/Panopto/Pages/Viewer.aspx?id=e5d46f43-43b7-4c59-9567-b124013004b5



Joignez-vous à nous avec Zoom à l'aide de cette URL.
ID de réunion : 916 9097 5818, Code : 343273.
Numéros de téléphone : https://umontreal.zoom.us/u/abitNZzLg.
One tap mobile : +14388097799,,91690975818#,,,,,,0#,,343273#


Suivez ce lien pour vous inscrire à la liste de diffusion RALI-OLST.
http://rali.iro.umontreal.ca/rali/?q=fr/node/1631

Liste de tous les séminaires pour l'année :

1991 1992 1993 1994 1995 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024