1 of 66

CSCI 3280

Introduction to Multimedia Systems

(2026 Term 2)

Computer Science & Engineering

The Chinese University of Hong Kong

2 of 66

Announcement

  • We will have our second tutorial on Feb. 11.

​

  • For the assignment, submit your code/results/short report via Blackboard (No plagiarism).

​

3 of 66

Image Representation (2)

4 of 66

Previous Feature Extraction

5 of 66

Feature Extraction with DL

6 of 66

What makes a good Feature? (1)

7 of 66

What makes a good Feature?(2)

8 of 66

Local Feature vs. Global Features

9 of 66

SIFT Feature

10 of 66

Convolutional Neural Networks

11 of 66

Fully Connected Layer

12 of 66

Locally Connected Layer

13 of 66

Convolutional Layer

14 of 66

Convolutional Layer

15 of 66

Convolutional Layer

16 of 66

Convolutional Layer

17 of 66

Convolutional Layer

18 of 66

Convolutional Layer

19 of 66

Convolutional Layer

20 of 66

Convolutional Layer

21 of 66

Convolutional Layer

22 of 66

Convolutional Layer

23 of 66

Convolutional Layer

24 of 66

Convolutional Layer

25 of 66

Pooling Layer

26 of 66

Pooling Layer

27 of 66

An Example of CNN

28 of 66

CNN: Image Classification

  • Data download and import libararies

29 of 66

  • Network architecture:

CNN: Image Classification

30 of 66

  • Loss function and optimizer:
  • Train the network:

CNN: Image Classification

31 of 66

  • Predict and test:

CNN: Image Classification

32 of 66

Summary

  • Feature extraction for image;

​

  • Convolutional Neural Networks;

​

  • How to build a CNN for image classification.

33 of 66

CNN Models History

34 of 66

Review: LeNet-5

35 of 66

Review: AlextNet

36 of 66

Review: AlextNet

37 of 66

Review: AlextNet

38 of 66

Review: AlextNet

39 of 66

Review: AlextNet

40 of 66

Review: ZFNet

41 of 66

Review: VGG

42 of 66

Review: VGG

43 of 66

Review: GoogLeNet

44 of 66

Review: GoogLeNet

45 of 66

Review: GoogLeNet

46 of 66

Review: GoogLeNet

47 of 66

Review: GoogLeNet

48 of 66

Review: GoogLeNet

49 of 66

Review: GoogLeNet

50 of 66

Review: ResNet

51 of 66

Review: ResNet

52 of 66

Review: ResNet

53 of 66

Review: ResNet

54 of 66

Review: ResNet

55 of 66

Review: ResNet

56 of 66

Review: ResNet

57 of 66

Computational Comparisons

58 of 66

Network in Network (NIN)

59 of 66

ResNeXt

60 of 66

Deep Networks with Stochastic Depth

61 of 66

DenseNet

62 of 66

 

Vision Transformer

63 of 66

 

DeiT: Data-efficient Image Transformers

64 of 66

 

Swin Transformer

65 of 66

 

SimCLR: Contrastive Learning

66 of 66

 

MAE