Skip to main content Link Menu Expand (external link) Copy Copied
Domain Generalization Tutorial

A Tutorial on Domain Generalization

1:30-5:00 pm, Monday, February 27th, Singapore

NEW: We will discuss ChatGPT vs. OOD robustness at the tutorial!

[Slides 1: DG] [Slides 2: ChatGPT robustness] [Paper] [Code]

Previous tutorial: IJCAI’22.

Introduction

Machine learning model relies heavily on the availability of massive training data. For low-resource scenarios where the well-labeled data is hard to obtain, it is important to conduct cross-domain knowledge transfer to from the existing domains to the target domain. For this problem, great progress has been made in transfer learning and domain adaptation areas. Beyond these advances, it is of great importance to learn models that can generalize well in any new unseen environment. This motivates the research community to develop algorithms to better harness the existing training domains while handling their distribution shift.

This tutorial is dedicated to introducing the latest advancements in Domain Generalization (DG). Different from transfer learning and domain adaptation that assume the availability of target domain data, DG takes a step further that does not require the access of target data. The purpose of DG is to learn a generalized model from one or several training domains with different probability distributions that can achieve good out-of-distribution generalization. The potential audience will be machine learning researchers and industry practitioners, with special interest in transfer learning, domain adaptation and generalization. Our tutorial aims to make these techniques easier to learn and use in real applications.

Presenters

  • Jindong Wang, Microsoft Research Asia, jindong.wang (at) microsoft.com
  • Haoliang Li, City University of Hong Kong, haoliang.li (at) cityu.edu.hk
  • Sinno Jialin Pan, The Chinese University of Hong Kong, sinnopan (at) cuhk.edu.hk
  • Xing Xie, Microsoft Research Asia, xingx (at) microsoft.com

Outline

  • Introduction and background
  • Related research areas
  • Methodology of DG
  • Applications
  • Datasets, benchmarks, and evaluations
  • Theory and future challenges
  • ChatGPT vs. OOD robustness?

Codebase

DeepDG: https://github.com/jindongwang/transferlearning/tree/master/code/DeepDG

Reference

  • Wang et al. Generalizing to unseen domains: a survey on domain generalization. IEEE Transactions on Knowledge and Data Engineering (TKDE) 2022: https://arxiv.org/abs/2103.03097