1 of 18

VIBE: Video Inference for Human Body Pose

and Shape Estimation

CVPR 2020

June 5, 2023

Presenter, Jeongwan On

2 of 18

0. Introduction

  • Tremendous progress has been made on estimating 3D human pose and shape from a single image.

  • While this is useful for many applications, it is the motion of the body in the world that tells us about human behavior.

  • While this problem has received over 30 years of study, we may ask why reliable methods are still not readily available
  1. Lack of 2D-3D mapping annotations
  2. Lack of in-the-wild datasets

3 of 18

0. Introduction

4 of 18

1. Architecture

5 of 18

2. Generator

6 of 18

2. Generator – Feature extractor(CNN)

7 of 18

2. Generator – Temporal Encdoer (GRU)

 

 

8 of 18

2. Generator - Regressor

9 of 18

3. Discriminator

10 of 18

3. Discriminator

11 of 18

4. Loss - Discriminator

12 of 18

4. Loss – Generator

13 of 18

5. Experiments

14 of 18

5. Experiments

15 of 18

5. Experiments

16 of 18

5. Experiments

17 of 18

5. Experiments

18 of 18

Thank you!