Masked Image Modeling (MIM)

大纲

Preliminaries

  1. Pre-training + Fine-tuning in NLP
  2. BEiT
  3. MAE
  4. SimMIM

Efficient MIM

  1. Local MAE
  2. HiViT
  3. MixMIM
  4. GreenMIM
  5. Uniform Masking

MIM + previous SSL

  1. Siamese Image Modeling

Talk 视频回放

https://meeting.tencent.com/v2/cloud-record/share?id=ffe9ebbd-e533-4e73-809c-b917e6ebc913&from=3

Slide

链接: https://pan.baidu.com/s/1B_ZitN_eNqlXJTw2ko6hVg 提取码: u97v