Automated machine learning (AutoML) offers the promise of translating raw data into accurate predictions without the need for significant human effort, expertise, and manual experimentation. In this workshop, we introduce AutoGluon, a state-of-the-art and easy-to-use AutoML framework. We will emphasize how foundational models can streamline and enhance AutoML performance. Specifically, we will discuss our TabPFN-Mix and Chronos foundational model families for tabular and time series data, respectively.

We will introduce the real-world problems that AutoGluon can help you solve within three lines of code and the fundamental techniques adopted in the toolkit. Rather than diving deep into the mechanisms underlining each individual ML model, we emphasize on how you can take advantage of a diverse collection of models to build an automated ML pipeline.

Additionally, we will present AutoGluon-Assistant (AG-A), which advances AutoGluon's automation from three lines of code to zero. AG-A allows users to solve supervised tabular learning problems using only natural language descriptions. By integrating the natural language understanding capabilities of large language models (LLMs) with AutoGluon's advanced AutoML features, AG-A delivers highly accurate and competitive ML solutions based solely on the data and a natural language description of the problem.

Join us at NeurIPS 2024 in West Ballroom C of the Vancouver Convention Center on Tuesday, December 10th at 12:00 noon PST.

Schedule

There will be a 5 min QA at the end of each section. A link to the slides will be provided prior to the talk.

Topic	Speaker	Duration (CST timezone)	Links	Cheatsheet
Introduction + AutoGluon Tabular	Nick Erickson	12:00PM -- 12:30PM	slides, tabular tutorial, docs
AutoGluon Assistant	Boran Han	12:30PM -- 12:45PM	slides, AG-A tutorial, docs
AutoGluon TimeSeries	Abdul Fatir Ansari	12:45PM -- 01:15PM	slides, timeseries quick start, chronos tutorial, docs
AutoGluon Multimodal	Shuai Zhang	01:15PM -- 01:30PM	slides, multimodal tutorial, docs
Additional QA + Feedback	All speakers	TBD

Section Outline and Materials

AutoGluon Tabular

• AutoML Basics: Discussion of core AutoML principles
• History of competition ML and how it influenced the design of modern AutoML systems
• Discussion of model combination strategies (stacking, bagging, model aggregation)
• Constraint satisfaction and engineering for a performance envelope (accuracy, speed, compute resources)
• Benchmark comparisons showcasing the advancement of AutoML systems in recent years both compared to earlier AutoML systems and human data scientists
• AutoGluon's performance and adoption on live kaggle competitions in 2024
• New TabPFN-Mix model and parallel model fit support

AutoGluon Assistant

• Overview of AutoGluon Assistant (AG-A) with zero line of code
• Performance of AG-A on Kaggle Competitions
• AG-A design with LLM and AutoGluon
• Installation, Tutorials and Demo of AG-A

AutoGluon TimeSeries

• Introduction to time series forecasting
• Local models, global models and pretrained models
• Discussion on Chronos model
• New Chronos-Bolt model and zero-shot results
• Discussion on how pretrained models like Chronos improve the speed-accuracy Pareto frontier
• Chronos in AutoGluon v1.2: zero-shot inference, fine-tuning and covariates support

AutoGluon Multimodal

• WIP

Hands-on Notebooks

Checkout the AutoGluon Website and get started!