Towards Fair and Generalizable Machine Learning with Large Models
Friday, March 4, 2022 11am to 12:15pm
About this Event
Science & Engineering Complex 1.413
Recent years have witnessed major advances in data science, driven by increasingly large neural networks. While these models hold great promise, modern machine learning applications motivate fine-grained performance control, spanning fairness, robustness, and accuracy. This talk will introduce new strategies to ensure these models behave the way we want.
I will first discuss optimizing fairness objectives on datasets with imbalanced or sensitive groups. We observe that a large model can achieve seemingly perfect fairness on training data but dramatically fail at the test-time. We show that this is due to overfitting as well as ineffectiveness of the traditional approaches. To address this, we propose a new family of fairness-seeking loss functions that better guide the training process and use it to achieve state-of-the-art performance.
As a key ingredient of generalizable learning, I will motivate bilevel problem formulations which help avoid overfitting, select the right model, and overcome distribution shift between training and validation data. Finally, I will introduce new bilevel optimization methods for federated learning across decentralized clients. These methods achieve provable communication and computation efficiency, overcome client heterogeneity, and gracefully specialize to min-max optimization.
I will conclude the talk with a discussion of future research on the theoretical foundations of deep learning, resource-efficient ML architectures, and data-driven control problems.
Event Details
Dial-In Information
Join by telephone (use any number to dial in)
+1 929 436 2866
+1 301 715 8592
+1 312 626 6799
+1 669 900 6833
+1 253 215 8782
+1 346 248 7799