1 of 21

ICG Final project demo

Motion retarget �for hand drawing character

電信一 R11942161 顏子鈞

電信一 R11942085 許宸睿

電信一 R11942118 李振勳

1

2 of 21

outline

  • Project Description
  • Demo
  • Pipeline
  • Implementation Details
  • Conclusion
  • Reference
  • Endnote

2

3 of 21

Project description

Motion Retarget

Let’s Bring our 2D hand drawing figure alive!

  • Input: hand drawing figure + target motion video
  • Output: motion retargeted video

​

​

3

4 of 21

demo

4

5 of 21

Pipeline

5

6 of 21

Pipeline (step-by-step)

6

7 of 21

Pipeline (step-by-step)

7

8 of 21

Pipeline (step-by-step)

8

9 of 21

Pipeline (step-by-step)

9

10 of 21

Pipeline (step-by-step)

10

11 of 21

Pipeline (step-by-step)

11

Rotation + translation + scaling

12 of 21

Implementation details (figure masking)

Our mask

Meta’s mask

12

13 of 21

Implementation details (figure masking)

Our mask

Meta’s mask

13

14 of 21

Implementation details (triangle mesh)

14

From Image to Triangles:

origin figure

Select 1/2 feature point

Select 1/5 feature point

Select 1/100 feature point

15 of 21

Implementation details (rendering order)

W/O Painter’s algorithm

W/ Painter’s algorithm (no more flickering!)

15

16 of 21

Implementation details (extra feature: motion)

W/O moving offset

W/ moving offset (motion more realistic!)

16

17 of 21

Implementation details (extra feature: ear rigidity)

W/O ear adjustment

W/ ear adjustment

(more correct placement)

​

17

Original

figure

18 of 21

Let’s compare with meta’s result!

META’s result

Ours result

18

19 of 21

conclusion

Topics learned in CG class, which applies in our project:

  • Split object into triangle meshes
  • Render each triangle mesh using different shading method. (we currently only implemented flat shading)
  • Using Painter’s algorithm to decide the rendering order

19

20 of 21

reference

This implementation is based on:

  • "A Method for Animating Children's Drawings of the Human Figure" (SIGGRAPH 2023)
  • "Implementing As-Rigid-As-Possible Shape Manipulation and Surface Flattening" (Journal of Graphics Gpu & Game Tools, 2009)
  • Github: facebookresearch/AnimatedDrawings
    • we only refer to code in animated_drawings/model/arap.py

20

21 of 21

ENDNote

Thanks for listening!

  • Our project repo is at https://github.com/ray-qwer/CG_Final
  • All source code are written in python,�Feel free to play it yourself!

21

QR for github repo