Séminaires RALI-OLST

Large Language Models as Proposers

Hongyuan Mei (hongyuan <at> ttic (point) edu)

Toyota Technological Institute at Chicago (TTIC)

Wednesday 8 November 2023 at 11:30 AM

Réunion Zoom, below — La présentation sera également projetée en salle 3195 du Pav. André-Aisenstadt


Abstract: In recent years, large language models (LLMs) have emerged as transformative tools in the realm of artificial intelligence. They show strong language understanding and reasoning capabilities, presenting a wealth of opportunities for solving challenging problems. However, deploying them as independent problem solvers---even with sophisticated prompting techniques---often ends up with unsatisfactory results.

In this talk, I will introduce an alternative approach, which incorporates LLMs within a larger framework for complex reasoning. Here, LLMs propose solutions or logical pathways, which are then analyzed and utilized by the framework. We will showcase two challenging problems effectively addressed using this paradigm. The first is text-based logical reasoning, in which one has to determine the truth value of a statement given a set of rules and facts, expressed in human natural language. The second is event prediction, the task of reasoning about future events given the past. For both problems, our LLM-in-the-loop frameworks learn to provide high-quality output beyond what an LLM can offer as a standalone problem solver.

I will sketch a few future research directions for improving the fundamental reasoning capabilities of LLMs, including embedding an LLM within a reinforcement learning framework to develop foundation world models.

Bio: Hongyuan Mei is currently a Research Assistant Professor at Toyota Technological Institute at Chicago (TTIC). He obtained his PhD from the Department of Computer Science at Johns Hopkins University (JHU), where he was advised by Jason Eisner.

Hongyuan's research spans machine learning and natural language processing. Currently, he is most interested in harnessing and improving the reasoning capabilities of large language models to solve challenging problems such as event prediction.

His research has been supported by a Bloomberg Data Science PhD Fellowship, the 2020 JHU Jelinek Memorial Award, and research gifts from Adobe and Ant Group. His technical innovations have been integrated into real-world products such as Alipay, the world’s largest mobile digital payment platform, which serves more than one billion users. His research has been covered by Fortune Magazine and Tech At Bloomberg.

Recording: https://drive.google.com/file/d/1JLjeteQLwcVhZeKXQoDj_msgMkTM0s7X/view?usp=drive_link



Join with Zoom at this url.
Meeting ID: 916 9097 5818, 𝑷𝒂𝒔𝒔𝒄𝒐𝒅𝒆: 343273.
Phone numbers: https://umontreal.zoom.us/u/abitNZzLg.
One tap mobile: +14388097799,,91690975818#,,,,,,0#,,343273#


Follow this link to subscribe to future RALI-OLST announcements.
http://rali.iro.umontreal.ca/rali/?q=fr/node/1631

See all the weekly talks for the year:

1991 1992 1993 1994 1995 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024