Just the Docs
A Tutorial on Domain Generalization
1:30-5:00 pm, Monday, February 27th, Singapore
NEW: We will discuss ChatGPT vs. OOD robustness at the tutorial!
[Slides 1: DG] [Slides 2: ChatGPT robustness] [Paper] [Code]
Previous tutorial: IJCAI’22.
Introduction
Machine learning model relies heavily on the availability of massive training data. For low-resource scenarios where the well-labeled data is hard to obtain, it is important to conduct cross-domain knowledge transfer to from the existing domains to the target domain. For this problem, great progress has been made in transfer learning and domain adaptation areas. Beyond these advances, it is of great importance to learn models that can generalize well in any new unseen environment. This motivates the research community to develop algorithms to better harness the existing training domains while handling their distribution shift.
This tutorial is dedicated to introducing the latest advancements in Domain Generalization (DG). Different from transfer learning and domain adaptation that assume the availability of target domain data, DG takes a step further that does not require the access of target data. The purpose of DG is to learn a generalized model from one or several training domains with different probability distributions that can achieve good out-of-distribution generalization. The potential audience will be machine learning researchers and industry practitioners, with special interest in transfer learning, domain adaptation and generalization. Our tutorial aims to make these techniques easier to learn and use in real applications.
Presenters
- Jindong Wang, Microsoft Research Asia, jindong.wang (at) microsoft.com
- Haoliang Li, City University of Hong Kong, haoliang.li (at) cityu.edu.hk
- Sinno Jialin Pan, The Chinese University of Hong Kong, sinnopan (at) cuhk.edu.hk
- Xing Xie, Microsoft Research Asia, xingx (at) microsoft.com
Outline
- Introduction and background
- Related research areas
- Methodology of DG
- Applications
- Datasets, benchmarks, and evaluations
- Theory and future challenges
- ChatGPT vs. OOD robustness?
Codebase
DeepDG: https://github.com/jindongwang/transferlearning/tree/master/code/DeepDG
Reference
- Wang et al. Generalizing to unseen domains: a survey on domain generalization. IEEE Transactions on Knowledge and Data Engineering (TKDE) 2022: https://arxiv.org/abs/2103.03097