1 of 149

<< Neural Network & Generative Modelling >>

Week 7

CCAI 9012

GenAI Solutions to Global Challenges: �Using AI Creatively and Responsibly

Kam-Ming Mark Tam

Class Coordinator

Impressionist-style scene of human–AI co-existence

Generated with ChatGPT (OpenAI), 2026.

Kanxuan HE

Naixiang GAO

Yifan XIE

Chao TANG

May Loaay Mohamed EL-HADIDI

Joseph Jing Hymn WONG

Christina Ka Man CHU

Charles Wai Lam TO

Shum Nga MAN

BT 1 (ARCH 2056/7330) Building Technology 1 : Building Principles

25/03/2026

1

Kam-Ming Mark TAM

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

1

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

2 of 149

General Matters

All About Neural Networks

Basics

Extension

[Break]

Generative Modelling

Traditional

LLMs

[Break]

Course Project

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

2

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

3 of 149

General Matters

All About Neural Networks

Basics

Extension

[Break]

Generative Modelling

Traditional

LLMs

[Break]

Course Project

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

3

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

4 of 149

Review of Timeline

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

4

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

5 of 149

Milestones & Corresponding Items

A.1.1: Responsibility and AI

A.1.2: Mechanics of AI

A.1.3: Datasets in AI

2026.02.26

2026.04.01

2026.04.29

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

5

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

6 of 149

Case Study General Rubric

Four Components to Deliver

  • i. Annotation & Title
    • 500 words

  • ii. Key Artefact
    • flexible: can take the form of a document, research poster, website, video, etc

  • iv. Evidences (Assignment-Specific)

  • iii. Vignette (Short-Form Video)
    • 90-second Long
    • highlight key insights & significance

i

ii

iii

iv

&

ii

iv

i

iii

+ image slides with explanatory context

Column 3

feel free to incorporate content into video to support

storytelling

Column 1

Column 3

Column 2

Column 2

Column 1

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

6

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

7 of 149

Milestones & Corresponding Items

Team Formation Form

Mid-term Pecha-Kucha Presentation

Crit-Style Peer Review (at mid-term & finals)

Final Presentation Submission

Individual Reflection

Peer Assessment

2026.02.25

2026.03.18

by tutorial sign-up

2026.04.22

2026.05.06

2026.05.06

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

7

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

8 of 149

A.2 Course Project - Mid-term Pecha-Kucha Presentation

Deadline: 📅 2026.03.18 ⏰ 00:00

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

8

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

9 of 149

The Hook: A little motivation…

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

9

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

10 of 149

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

10

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

11 of 149

Imagine you are a LLM… how will you answer this?

1+1=

3

0

1

2

4

#

#

5

?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

11

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

12 of 149

1+1=

3

0

1

2

4

#

#

5

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

12

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

13 of 149

Imagine you are a LLM… how will you answer this?

2+2=

3

0

1

2

4

#

#

5

?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

13

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

14 of 149

General Matters

All About Neural Networks

Basics

Extension

[Break]

Generative Modelling

Traditional

LLMs

[Break]

Course Project

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

14

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

15 of 149

Linear Regression

y=wx+b

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

15

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

16 of 149

x

y

IN

x

y

OUT

IN

x

y

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

16

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

17 of 149

Neural Network Motivation: Beyond Linearity

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

17

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

18 of 149

Neural Network Motivation: Beyond Linearity

+

+

+

+

+

+

+

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

18

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

19 of 149

Neural Network Motivation: Beyond Linearity

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

19

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

20 of 149

Neural Network Motivation: Beyond Linearity

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

20

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

21 of 149

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

21

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

22 of 149

Neural Network Motivation: Beyond Linearity

 

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

22

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

23 of 149

Neural Networks Introduces Non-linearity

 

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

23

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

24 of 149

Activation Functions

Neural Networks Introduces Non-linearity

.

.

.

σ(·)

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

24

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

25 of 149

Neural Networks Introduces Non-linearity

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

25

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

26 of 149

Universal Approximation Theorem

Neural Networks Introduces Non-linearity

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

26

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

27 of 149

Single Neuron

Anatomy of a Neural Network

Σ

w

ϕ(·)

×

b

x

y

INPUT

HIDDEN

OUTPUT

LAYERS

neuron

activation

function

bias

weight

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

27

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

28 of 149

Single Neuron & Multi-Variate Inputs

Anatomy of a Neural Network

INPUT

HIDDEN

OUTPUT

LAYERS

neuron

activation

function

Σ

ϕ(·)

y

w

×

w1

b

x2

x1

w2

xD

×

xD

×

D

1

x1

x2

+

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

28

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

29 of 149

Single Neuron & Multi-Variate Inputs

Anatomy of a Neural Network

INPUT

HIDDEN

OUTPUT

LAYERS

neuron

activation

function

Σ

ϕ(·)

y

w

×

w1

b

xD

x1

wD

···

xD

×

xD

×

D

1

x1

xD

+

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

29

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

30 of 149

Neural Network Motivation: Beyond Linearity

 

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

30

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

31 of 149

Neural Network Motivation: Beyond Linearity

 

2

1

x1

x2

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

31

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

32 of 149

Neural Network Motivation: Beyond Linearity

 

D

1

x1

xD

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

32

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

33 of 149

Neural Network Motivation: Beyond Linearity

 

D

1

2

1

x1

xD

x1

x2

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

33

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

34 of 149

Neural Network Motivation: Beyond Linearity

 

D

1

K

1

x1

xD

x1

xk

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

34

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

35 of 149

Artifical neural network

……

INPUT

HIDDEN

OUTPUT

l = 0

l = 1

l = L

l = 2

W(0)

W(1)

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

35

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

36 of 149

From Single Neuron & Multi-Variate Inputs to Multiple Neurons & Multi-Variate Inputs

Anatomy of a Neural Network

dim_in = 2

dim_out = 1

n_hidden_layer = 1

dim_hidden = 1

dim_in = 2

dim_out = 1

n_hidden_layer = 1

dim_hidden =4

dim_in = 2

dim_out = 1

n_hidden_layer = 2

dim_hidden = 4

dim_in = 2

dim_out = 2

n_hidden_layer = 2

dim_hidden = 4

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

36

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

37 of 149

What about for classification problems?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

37

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

38 of 149

x

category

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

38

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

39 of 149

any value x

larger than 0?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

39

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

40 of 149

Classification

TRUE

FALSE

INPUT

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

40

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

41 of 149

Classification

+1

-1

INPUT

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

41

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

42 of 149

Classification

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

42

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

43 of 149

Neural Networks Introduces Non-linearity

 

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

43

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

44 of 149

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

44

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

45 of 149

Neural Networks Introduces Non-linearity

 

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

45

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

46 of 149

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

46

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

47 of 149

Positive

Negative

Positive

Negative

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

47

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

48 of 149

Positive

Negative

Positive

Negative

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

48

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

49 of 149

Neural Network Playground

Tensorflow Neural Network Playground

https://playground.tensorflow.org/

INTERACTIVE

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

49

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

50 of 149

General Matters

All About Neural Networks

Basics

Extension

[Break]

Generative Modelling

Traditional

LLMs

[Break]

Course Project

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

50

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

51 of 149

Vectors, Matrices & Tensors

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

51

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

52 of 149

Multiple Data Points

(x1,1,…, x1,D)

(x2,1,…, x2,D)

(xN,1,…, xN,D)

D

1

1

N

x1

x2

xD

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

52

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

53 of 149

Regular Grids: Pixels & Voxels

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

53

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

54 of 149

Image as Data Matrices

https://ai.stanford.edu/~syyeung/cvweb/tutorial1.html

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

54

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

55 of 149

Pixels Math in Image Editing

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

55

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

56 of 149

Neural Network Paradigms: NN

https://ai.stanford.edu/~syyeung/cvweb/tutorial1.html

Standard NN learns each data entry independently from one another.

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

56

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

57 of 149

Neural Network Paradigms: CNN

https://ai.stanford.edu/~syyeung/cvweb/tutorial1.html

Convolutional Neural Networks leverages spatial relation of pixel entries and learn over neighbourhoods…

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

57

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

58 of 149

Source: https://setosa.io/ev/image-kernels/

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

58

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

59 of 149

Convolution Neural Network

Output/Feature Map Size:

H(l+1) × W(l+1)

Kernel Size

Padding

Stride

Size Hl) × W()

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

59

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

60 of 149

Analogy to Image Filters

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

60

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

61 of 149

Image as RGB Channels

Source: https://dev.to/sandeepbalachandran/machine-learning-convolution-with-color-images-2p41

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

61

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

62 of 149

Convolutional Neural Network

Source: https://www.analyticsvidhya.com/blog/2020/10/what-is-the-convolutional-neural-network-architecture/

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

62

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

63 of 149

Convolutional Neural Network

Source: https://www.analyticsvidhya.com/blog/2020/10/what-is-the-convolutional-neural-network-architecture/

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

63

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

64 of 149

Convolutional Neural Network

Low Level Features

Mid-Level Features

High Level Features

Source: https://www.analyticsvidhya.com/blog/2020/10/what-is-the-convolutional-neural-network-architecture/

edges, dark spots

eyes, ears, nose

facial structures

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

64

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

65 of 149

CNN Explaner

Visualisation of Image Kernels

https://setosa.io/ev/image-kernels/

INTERACTIVE

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

65

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

66 of 149

CNN Explaner

Visualisation on the Learning of CNN Classifers

INTERACTIVE

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

66

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

67 of 149

Beyond Euclidean Data

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

67

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

68 of 149

Euclidean Data

Non-Euclidean Data

  • Defined in a regular geometric space
  • Structure defined by coordinates / feature vectors
  • Consistent neighbourhood structure
  • Defined in irregular or relational space
  • Structure defined by relations of elements & their features
  • Neighbourhood structure varies across elements

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

68

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

69 of 149

Learning directly from reality, which is discrete*

*real-life phenomena are more appropriately described as discrete systems

RELATION

DECISIONS

TEMPORAL

SYSTEMS ACROSS SPATIAL SCALES

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

69

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

70 of 149

Two Graphs

Motivations for Graph ML

node

data

pattern

pattern

edge

data

node

data

edge

data

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

70

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

71 of 149

Connectivity Differences

Motivations for Graph ML

node

data

pattern

pattern

edge

data

node

data

edge

data

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

71

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

72 of 149

Comparison Difficulties

Motivations for Graph ML

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

72

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

73 of 149

Graph Representation

Adjacency

Features

?

?

=

and

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

73

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

74 of 149

Graph Representation

0

1

2

Adjacency

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

74

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

75 of 149

Graph Representation

0

1

2

Adjacency

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

75

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

76 of 149

Graph Representation

0

1

2

Adjacency

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

76

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

77 of 149

Graph Representation

0

1

2

Adjacency

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

77

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

78 of 149

Graph Representation

Adjacency

Features

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

78

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

79 of 149

Artifical neural network

……

INPUT

HIDDEN

OUTPUT

l = 0

l = 1

l = L

l = 2

W(0)

W(1)

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

79

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

80 of 149

Geometric message passing network

W(0)

HIDDEN

OUTPUT

l = 0

l = 1

l = L

l = 2

W(1)

INPUT

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

80

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

81 of 149

Geometric message passing network

INPUT

W(0)

HIDDEN

OUTPUT

l = 0

l = 1

l = L

l = 2

W(1)

W(l)

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

81

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

82 of 149

Geometric message passing network

W(0)

HIDDEN

OUTPUT

l = 0

l = 1

l = L

l = 2

W(1)

INPUT

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

82

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

83 of 149

Graph Explanation

A Gentle Introduction to GNN

https://distill.pub/2021/gnn-intro/

INTERACTIVE

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

83

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

84 of 149

Attendance Check

Let’s switch things up a bit ;)

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

84

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

85 of 149

Course Project Support

Course Project Discussions

Thoughtful instructor listening as student teams discuss their projects in a bright university classroom. One team presents near a whiteboard with simple AI diagrams (data → model → output) while other teams watch attentively. Students are engaged, smiling, and collaborative. Natural candid classroom photography.

Generated with ChatGPT (OpenAI), 2026.

ACTIVITY

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

85

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

86 of 149

General Matters

All About Neural Networks

Basics

Extension

[Break]

Generative Modelling

Traditional

LLMs

[Break]

Course Project

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

86

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

87 of 149

General Matters

All About Neural Networks

Basics

Extension

[Break]

Generative Modelling

Traditional

LLMs

[Break]

Course Project

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

87

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

88 of 149

On Distribution

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

88

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

89 of 149

On Distribution

Thought Experiment: �Let’s generate a typical Hong Konger…

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

89

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

90 of 149

On Distribution

What are key attributes that describe a person?

e.g. age, gender, income, height, weight….

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

90

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

91 of 149

On Distribution

Features live in data distributions with different shapes…

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

91

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

92 of 149

What do we mean when we are creating a generator?

Note: synthetic data generated by ChatGPT

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

92

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

93 of 149

Data Distribution

Conceptual Illustration of Data Generator

Note: synthetic data generated by ChatGPT

Where in the design space should our generator create its designs?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

93

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

94 of 149

Valid Generated Data Point

Conceptual Illustration of Data Generator

Note: synthetic data generated by ChatGPT

✅ 👍 😃

This looks like a plausible generated data point.

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

94

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

95 of 149

Questionable Generated Data Point

Conceptual Illustration of Data Generator

Note: synthetic data generated by ChatGPT

❌ 👎 🤨

This is clearly outside of the distribution… not plausible.

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

95

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

96 of 149

Generative Modelling

A Tight Definition

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

96

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

97 of 149

Structural Design Space Example

Material Minimisation in 2-Bar Sysem

  • Example Adapted from Mueller (2014)

x2

x1

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

97

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

98 of 149

Simple Structural Design Space Example

Material Minimisation in 2-Bar Sysem

  • Example Adapted from Mueller (2014)

x2

x1

Low

High

Let’s create some design options

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

98

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

99 of 149

Simple Structural Design Space Example

Material Minimisation in 2-Bar Sysem

  • Example Adapted from Mueller (2014)

Low

High

Structural Material Requirement

Where are the good designs?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

99

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

100 of 149

Simple Structural Design Space Example

Material Minimisation in 2-Bar Sysem

  • Example Adapted from Mueller (2014)

x2

x1

Data points of interest tend to live within complexly shaped distributions…

Low

High

Structural Material Requirement

Where in the design space should our generator create its designs?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

100

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

101 of 149

Simple Structural Design Space Example

Material Minimisation in 2-Bar Sysem

  • Example Adapted from Mueller (2014)

x2

x1

Data points of interest tend to live within complexly shaped distributions…

+

+

+

+

+

+

+

+

+

+

Low

High

probability

Structural Material Requirement

Where in the design space should our generator create its designs?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

101

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

102 of 149

Variational Auto-Encoders

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

102

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

103 of 149

Dimensionality Reduction by Manifold Learning : Concepts

H = W = 28

X ∈ ℝ H × W = 784

0

H

W

x1

x784

+

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

103

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

104 of 149

Variational Auto-Encoder

Dimensionality Reduction

ENC

z

 

xD

x1

x1

xD

+

+

+

+

+

+

+

+

+

+

+

+

+

+

DEC

 

Decoder

Encoder

z1

z2

+

+

+

+

+

+

+

+

+

+

+

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

104

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

105 of 149

Variational Auto-Encoder

Dimensionality Reduction

ENC

 

xD

x1

x1

xD

+

+

+

+

+

+

+

+

+

+

+

+

+

+

DEC

 

Decoder

Encoder

z1

z2

+

+

+

+

+

+

+

+

+

+

+

z

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

105

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

106 of 149

“Serenity Visions: AI-Generated Patterns for a Calming Audio-Visual Experience”

Yuheng Karina Xiang

RESEARCH

INITIAL IMAGES

INTERATIVE IMAGES DEVELOPMENT

VIDEO

Design Space: Generative Image-to-Image Video Interpolation

Process: Visual Pattern Generation Pipeline

Design Space: AI-Generated Visual Pattern

Example of Generative Interpolation

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.02.25

106

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

107 of 149

Variational Auto-Encoder

Encoding & Decoding MNIST

…/weekly_scripts/S2_generative_NN/vae.ipynb

VAE�DEC

INTERACTIVE

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

107

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

108 of 149

VAE Applied to Structural Design

zLoadPath

zk

Structural Performance Latent Dimension

Other Latent Dimensions set to 0.0

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

108

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

109 of 149

VAE Applied to Structural Design

Interactive Design Tool for Performance-Based Design Interpolation

2× playback speed

Structural Performance

Other Latent Dimensions

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

109

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

110 of 149

Generative Adversarial Network

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

110

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

111 of 149

z1

z2

?

z1

z2

x1

x2

x1

x2

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

111

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

112 of 149

z1

z2

?

z1

z2

x1

x2

x1

x2

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

112

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

113 of 149

z1

z2

?

z1

z2

x1

x2

x1

x2

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

113

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

114 of 149

z1

z2

?

z1

z2

x1

x2

x1

x2

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

114

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

115 of 149

General Matters

All About Neural Networks

Basics

Extension

[Break]

Generative Modelling

Traditional

LLMs

[Break]

Course Project

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

115

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

116 of 149

1+1=

3

0

1

2

4

#

#

5

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

116

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

117 of 149

The capital city of China is

Chongqing

Beijing

Shanghai

Xian

Xianggang

Washington, D.C.

Paris

?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

117

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

118 of 149

The capital city of China is

Chongqing

Beijing

Shanghai

Xian

Xianggang

Washington, D.C.

Paris

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

118

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

119 of 149

Imagine you are a LLM… how will you answer this?

2+2=

3

0

1

2

4

#

#

5

?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

119

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

120 of 149

Imagine you are a LLM… how will you answer this?

*see George Orwell’s 1984 or the song by Radiohead inspired by it. 🤓

2+2=

3

0

1

2

4

#

#

5

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

120

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

121 of 149

LLM does not learn truth… �it learns statistical structure from large text corpus…

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

121

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

122 of 149

 

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

122

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

123 of 149

What are tokens?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

123

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

124 of 149

 

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

124

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

125 of 149

Text Completion Model

床前明月__

An Intuitive Example

《静夜思》, 李白 (Li Bai)

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

125

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

126 of 149

Imagine you are a LLM… how will you answer this?

床前明月__

《静夜思》, 李白 (Li Bai)

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

126

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

127 of 149

Text Completion Model

To be or not __

to be…

An Intuitive Example

<<Hamlet>>, William Shakespeare

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

127

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

128 of 149

Switzerland is…

orderly

scenic

beautiful

wealthy

demorcratic

poor

dirty

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

128

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

129 of 149

Generative Modelling : Top-K Sampling

The coolest city of China is

Beijing

Shanghai

Xian

Chongqing

Xianggang*

Washington, D.C.

Paris

The coolest city in China is Chongqing, known for its stunning mountainous landscapes, spicy cuisine, and vibrant nightlife scene,…

The coolest city in China is Beijing, known for its rich history, vibrant culture, and bustling street life…

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

129

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

130 of 149

How do we train LLMs?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

130

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

131 of 149

It was the best of times, it was the worst of times…

<<A Tale of Two Cities>>, Charles Dickens

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

131

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

132 of 149

Text Completion Model

An Intuitive Example

<<A Tale of Two Cities>>, Charles Dickens

It was the best of times, it was the worst of times…

was

the

best

times

worst

how

they

It …

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

132

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

133 of 149

Text Completion Model

An Intuitive Example

<<A Tale of Two Cities>>, Charles Dickens

It was the best of times, it was the worst of times…

was

the

best

times

worst

how

they

It …

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

133

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

134 of 149

Text Completion Model

An Intuitive Example

<<A Tale of Two Cities>>, Charles Dickens

It was the best of times, it was the worst of times…

was

the

best

times

worst

how

they

It

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

134

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

135 of 149

Text Completion Model

An Intuitive Example

<<A Tale of Two Cities>>, Charles Dickens

It was the best of times, it was the worst of times…

was

the

best

times

worst

how

they

It

was

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

135

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

136 of 149

Text Completion Model

An Intuitive Example

<<A Tale of Two Cities>>, Charles Dickens

It was the best of times, it was the worst of times…

was

the

best

times

worst

how

they

It

the

was

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

136

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

137 of 149

So we continue to infer… one token at a time.

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

137

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

138 of 149

What about embeddings?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

138

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

139 of 149

Artifical Neural Network

……

INPUT

HIDDEN

OUTPUT

l = 0

l = 1

l = L

l = 2

W(0)

W(1)

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

139

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

140 of 149

Text Completion Model

An Intuitive Example

<<A Tale of Two Cities>>, Charles Dickens

It was the best of times, it was the worst of times…

was

the

best

times

worst

how

they

It

the

was

x1

xD

x1

xD

+

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

140

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

141 of 149

But what was wrong with our silly example?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

141

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

142 of 149

Does “It was the” always need to be followed by the “best of times”?

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

142

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

143 of 149

A language model is not learning a single sentence.�It is learning the statistical structure of language across billions of contexts.

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

143

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

144 of 149

Context Matters!

Words do not follow each other deterministically.�Their probabilities depend on context.

Give LLMs specificies!

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

144

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

145 of 149

General Matters

All About Neural Networks

Basics

Extension

[Break]

Generative Modelling

Traditional

LLMs

[Break]

Course Project

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

145

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

146 of 149

General Matters

All About Neural Networks

Basics

Extension

[Break]

Generative Modelling

Traditional

LLMs

[Break]

Course Project

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

146

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

147 of 149

Course Project Support

Course Project Discussions

Thoughtful instructor listening as student teams discuss their projects in a bright university classroom. One team presents near a whiteboard with simple AI diagrams (data → model → output) while other teams watch attentively. Students are engaged, smiling, and collaborative. Natural candid classroom photography.

Generated with ChatGPT (OpenAI), 2026.

ACTIVITY

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

147

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

148 of 149

Course Project Support

Course Project Discussions

  • Paste your problems statements on to: Team Formation Form
  • Talk with your team; quick brainstom re:
    • What problem?
    • For whom?
    • Have you looked for precedents?
    • What small test will you run?
    • Is it achievable within 5 weeks?
    • How will you know if it helped?
  • Let’s chat about it…

ACTIVITY

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

148

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU

149 of 149

Thank You for Your Attention!

CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly

2026.03.04

149

Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU