<< Neural Network & Generative Modelling >>
Week 7
CCAI 9012
GenAI Solutions to Global Challenges: �Using AI Creatively and Responsibly
Kam-Ming Mark Tam
Class Coordinator
Impressionist-style scene of human–AI co-existence
Generated with ChatGPT (OpenAI), 2026.
Kanxuan HE
Naixiang GAO
Yifan XIE
Chao TANG
May Loaay Mohamed EL-HADIDI
Joseph Jing Hymn WONG
Christina Ka Man CHU
Charles Wai Lam TO
Shum Nga MAN
BT 1 (ARCH 2056/7330) Building Technology 1 : Building Principles
25/03/2026
1
Kam-Ming Mark TAM
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
1
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
General Matters
All About Neural Networks
Basics
Extension
[Break]
Generative Modelling
Traditional
LLMs
[Break]
Course Project
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
2
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
General Matters
All About Neural Networks
Basics
Extension
[Break]
Generative Modelling
Traditional
LLMs
[Break]
Course Project
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
3
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Review of Timeline
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
4
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Milestones & Corresponding Items
A.1.1: Responsibility and AI
A.1.2: Mechanics of AI
A.1.3: Datasets in AI
2026.02.26
2026.04.01
2026.04.29
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
5
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Case Study General Rubric
Four Components to Deliver
i
ii
iii
iv
&
ii
iv
i
iii
+ image slides with explanatory context
Column 3
feel free to incorporate content into video to support
storytelling
Column 1
Column 3
Column 2
Column 2
Column 1
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
6
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Milestones & Corresponding Items
Team Formation Form
Mid-term Pecha-Kucha Presentation
Crit-Style Peer Review (at mid-term & finals)
Final Presentation Submission
Individual Reflection
Peer Assessment
2026.02.25
2026.03.18
by tutorial sign-up
2026.04.22
2026.05.06
2026.05.06
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
7
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
A.2 Course Project - Mid-term Pecha-Kucha Presentation
Deadline: 📅 2026.03.18 ⏰ 00:00
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
8
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
The Hook: A little motivation…
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
9
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
10
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Imagine you are a LLM… how will you answer this?
1+1=
3
0
1
2
4
…
#
#
5
?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
11
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
1+1=
3
0
1
2
4
…
#
#
5
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
12
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Imagine you are a LLM… how will you answer this?
2+2=
3
0
1
2
4
…
#
#
5
?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
13
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
General Matters
All About Neural Networks
Basics
Extension
[Break]
Generative Modelling
Traditional
LLMs
[Break]
Course Project
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
14
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Linear Regression
y=wx+b
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
15
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
ℳ
x
y
IN
x
y
OUT
IN
x
y
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
16
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Motivation: Beyond Linearity
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
17
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Motivation: Beyond Linearity
+
+
+
+
+
+
+
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
18
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Motivation: Beyond Linearity
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
19
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Motivation: Beyond Linearity
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
20
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
21
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Motivation: Beyond Linearity
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
22
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Networks Introduces Non-linearity
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
23
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Activation Functions
Neural Networks Introduces Non-linearity
.
.
.
σ(·)
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
24
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Networks Introduces Non-linearity
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
25
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Universal Approximation Theorem
Neural Networks Introduces Non-linearity
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
26
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Single Neuron
Anatomy of a Neural Network
Σ
w
ϕ(·)
×
b
x
y
INPUT
HIDDEN
OUTPUT
LAYERS
neuron
activation
function
bias
weight
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
27
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Single Neuron & Multi-Variate Inputs
Anatomy of a Neural Network
INPUT
HIDDEN
OUTPUT
LAYERS
neuron
activation
function
Σ
ϕ(·)
y
w
×
w1
b
x2
x1
w2
xD
×
xD
×
…
D
1
x1
x2
+
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
28
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Single Neuron & Multi-Variate Inputs
Anatomy of a Neural Network
INPUT
HIDDEN
OUTPUT
LAYERS
neuron
activation
function
Σ
ϕ(·)
y
w
×
w1
b
xD
x1
wD
···
xD
×
xD
×
…
D
1
x1
xD
…
+
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
29
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Motivation: Beyond Linearity
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
30
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Motivation: Beyond Linearity
2
1
x1
x2
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
31
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Motivation: Beyond Linearity
…
D
1
x1
xD
…
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
32
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Motivation: Beyond Linearity
…
D
1
2
1
x1
xD
…
x1
x2
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
33
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Motivation: Beyond Linearity
…
D
1
…
K
1
x1
xD
…
x1
xk
…
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
34
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Artifical neural network
……
INPUT
HIDDEN
OUTPUT
l = 0
l = 1
l = L
l = 2
W(0)
W(1)
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
35
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
From Single Neuron & Multi-Variate Inputs to Multiple Neurons & Multi-Variate Inputs
Anatomy of a Neural Network
dim_in = 2
dim_out = 1
n_hidden_layer = 1
dim_hidden = 1
dim_in = 2
dim_out = 1
n_hidden_layer = 1
dim_hidden =4
dim_in = 2
dim_out = 1
n_hidden_layer = 2
dim_hidden = 4
dim_in = 2
dim_out = 2
n_hidden_layer = 2
dim_hidden = 4
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
36
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
What about for classification problems?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
37
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
x
category
ℳ
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
38
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
any value x
larger than 0?
ℳ
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
39
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Classification
TRUE
FALSE
INPUT
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
40
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Classification
+1
-1
INPUT
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
41
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Classification
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
42
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Networks Introduces Non-linearity
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
43
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
44
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Networks Introduces Non-linearity
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
45
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
46
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Positive
Negative
Positive
Negative
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
47
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Positive
Negative
Positive
Negative
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
48
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Playground
Tensorflow Neural Network Playground
https://playground.tensorflow.org/
INTERACTIVE
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
49
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
General Matters
All About Neural Networks
Basics
Extension
[Break]
Generative Modelling
Traditional
LLMs
[Break]
Course Project
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
50
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Vectors, Matrices & Tensors
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
51
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Multiple Data Points
(x1,1,…, x1,D)
(x2,1,…, x2,D)
…
(xN,1,…, xN,D)
…
…
…
D
1
1
N
x1
x2
xD
…
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
52
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Regular Grids: Pixels & Voxels
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
53
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Image as Data Matrices
https://ai.stanford.edu/~syyeung/cvweb/tutorial1.html
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
54
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Pixels Math in Image Editing
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
55
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Paradigms: NN
https://ai.stanford.edu/~syyeung/cvweb/tutorial1.html
Standard NN learns each data entry independently from one another.
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
56
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Neural Network Paradigms: CNN
https://ai.stanford.edu/~syyeung/cvweb/tutorial1.html
Convolutional Neural Networks leverages spatial relation of pixel entries and learn over neighbourhoods…
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
57
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Source: https://setosa.io/ev/image-kernels/
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
58
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Convolution Neural Network
Output/Feature Map Size:
H(l+1) × W(l+1)
Kernel Size
Padding
Stride
Size Hl) × W()
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
59
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Analogy to Image Filters
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
60
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Image as RGB Channels
Source: https://dev.to/sandeepbalachandran/machine-learning-convolution-with-color-images-2p41
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
61
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Convolutional Neural Network
Source: https://www.analyticsvidhya.com/blog/2020/10/what-is-the-convolutional-neural-network-architecture/
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
62
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Convolutional Neural Network
Source: https://www.analyticsvidhya.com/blog/2020/10/what-is-the-convolutional-neural-network-architecture/
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
63
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Convolutional Neural Network
Low Level Features
Mid-Level Features
High Level Features
Source: https://www.analyticsvidhya.com/blog/2020/10/what-is-the-convolutional-neural-network-architecture/
edges, dark spots
eyes, ears, nose
facial structures
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
64
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
CNN Explaner
Visualisation of Image Kernels
https://setosa.io/ev/image-kernels/
INTERACTIVE
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
65
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
CNN Explaner
Visualisation on the Learning of CNN Classifers
INTERACTIVE
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
66
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Beyond Euclidean Data
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
67
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Euclidean Data
Non-Euclidean Data
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
68
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Learning directly from reality, which is discrete*
*real-life phenomena are more appropriately described as discrete systems
RELATION
DECISIONS
TEMPORAL
SYSTEMS ACROSS SPATIAL SCALES
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
69
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Two Graphs
Motivations for Graph ML
node
data
pattern
pattern
edge
data
node
data
edge
data
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
70
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Connectivity Differences
Motivations for Graph ML
node
data
pattern
pattern
edge
data
node
data
edge
data
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
71
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Comparison Difficulties
Motivations for Graph ML
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
72
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Graph Representation
Adjacency
Features
?
?
=
and
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
73
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Graph Representation
0
1
2
Adjacency
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
74
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Graph Representation
0
1
2
Adjacency
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
75
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Graph Representation
0
1
2
Adjacency
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
76
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Graph Representation
0
1
2
Adjacency
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
77
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Graph Representation
Adjacency
Features
…
…
…
…
…
…
…
…
…
…
…
…
…
…
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
78
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Artifical neural network
……
INPUT
HIDDEN
OUTPUT
l = 0
l = 1
l = L
l = 2
W(0)
W(1)
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
79
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Geometric message passing network
W(0)
…
HIDDEN
OUTPUT
l = 0
l = 1
l = L
l = 2
W(1)
INPUT
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
80
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Geometric message passing network
…
INPUT
W(0)
HIDDEN
OUTPUT
l = 0
l = 1
l = L
l = 2
W(1)
W(l)
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
81
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Geometric message passing network
W(0)
…
HIDDEN
OUTPUT
l = 0
l = 1
l = L
l = 2
W(1)
INPUT
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
82
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Graph Explanation
A Gentle Introduction to GNN
https://distill.pub/2021/gnn-intro/
INTERACTIVE
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
83
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Attendance Check
Let’s switch things up a bit ;)
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
84
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Course Project Support
Course Project Discussions
Thoughtful instructor listening as student teams discuss their projects in a bright university classroom. One team presents near a whiteboard with simple AI diagrams (data → model → output) while other teams watch attentively. Students are engaged, smiling, and collaborative. Natural candid classroom photography.
Generated with ChatGPT (OpenAI), 2026.
ACTIVITY
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
85
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
General Matters
All About Neural Networks
Basics
Extension
[Break]
Generative Modelling
Traditional
LLMs
[Break]
Course Project
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
86
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
General Matters
All About Neural Networks
Basics
Extension
[Break]
Generative Modelling
Traditional
LLMs
[Break]
Course Project
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
87
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
On Distribution
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
88
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
On Distribution
Thought Experiment: �Let’s generate a typical Hong Konger…
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
89
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
On Distribution
What are key attributes that describe a person?
e.g. age, gender, income, height, weight….
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
90
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
On Distribution
Features live in data distributions with different shapes…
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
91
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
What do we mean when we are creating a generator?
Note: synthetic data generated by ChatGPT
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
92
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Data Distribution
Conceptual Illustration of Data Generator
Note: synthetic data generated by ChatGPT
Where in the design space should our generator create its designs?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
93
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Valid Generated Data Point
Conceptual Illustration of Data Generator
Note: synthetic data generated by ChatGPT
✅ 👍 😃
This looks like a plausible generated data point.
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
94
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Questionable Generated Data Point
Conceptual Illustration of Data Generator
Note: synthetic data generated by ChatGPT
❌ 👎 🤨
This is clearly outside of the distribution… not plausible.
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
95
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Generative Modelling
A Tight Definition
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
96
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Structural Design Space Example
Material Minimisation in 2-Bar Sysem
x2
x1
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
97
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Simple Structural Design Space Example
Material Minimisation in 2-Bar Sysem
x2
x1
Low
High
Let’s create some design options
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
98
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Simple Structural Design Space Example
Material Minimisation in 2-Bar Sysem
Low
High
Structural Material Requirement
Where are the good designs?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
99
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Simple Structural Design Space Example
Material Minimisation in 2-Bar Sysem
x2
x1
Data points of interest tend to live within complexly shaped distributions…
Low
High
Structural Material Requirement
Where in the design space should our generator create its designs?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
100
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Simple Structural Design Space Example
Material Minimisation in 2-Bar Sysem
x2
x1
Data points of interest tend to live within complexly shaped distributions…
+
+
+
+
+
+
+
+
+
+
Low
High
probability
Structural Material Requirement
Where in the design space should our generator create its designs?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
101
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Variational Auto-Encoders
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
102
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Dimensionality Reduction by Manifold Learning : Concepts
H = W = 28
X ∈ ℝ H × W = 784
0
H
W
x1
x784
…
+
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
103
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Variational Auto-Encoder
Dimensionality Reduction
ENC
z
xD
…
x1
x1
xD
…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
DEC
Decoder
…
…
Encoder
z1
z2
+
+
+
+
+
+
+
+
+
+
+
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
104
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Variational Auto-Encoder
Dimensionality Reduction
ENC
xD
…
x1
x1
xD
…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
DEC
Decoder
…
…
Encoder
z1
z2
+
+
+
+
+
+
+
+
+
+
+
z
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
105
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
“Serenity Visions: AI-Generated Patterns for a Calming Audio-Visual Experience”
Yuheng Karina Xiang
RESEARCH
INITIAL IMAGES
INTERATIVE IMAGES DEVELOPMENT
VIDEO
Design Space: Generative Image-to-Image Video Interpolation
Process: Visual Pattern Generation Pipeline
Design Space: AI-Generated Visual Pattern
Example of Generative Interpolation
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.02.25
106
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Variational Auto-Encoder
Encoding & Decoding MNIST
…/weekly_scripts/S2_generative_NN/vae.ipynb
VAE�DEC
INTERACTIVE
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
107
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
VAE Applied to Structural Design
zLoadPath
…
zk
Structural Performance Latent Dimension
Other Latent Dimensions set to 0.0
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
108
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
VAE Applied to Structural Design
Interactive Design Tool for Performance-Based Design Interpolation
2× playback speed
Structural Performance
Other Latent Dimensions
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
109
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Generative Adversarial Network
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
110
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
z1
z2
?
z1
z2
x1
x2
x1
x2
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
111
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
z1
z2
?
z1
z2
x1
x2
x1
x2
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
112
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
z1
z2
?
z1
z2
x1
x2
x1
x2
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
113
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
z1
z2
?
z1
z2
x1
x2
x1
x2
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
114
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
General Matters
All About Neural Networks
Basics
Extension
[Break]
Generative Modelling
Traditional
LLMs
[Break]
Course Project
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
115
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
1+1=
3
0
1
2
4
…
#
#
5
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
116
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
The capital city of China is
Chongqing
Beijing
Shanghai
Xian
Xianggang
…
Washington, D.C.
Paris
?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
117
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
The capital city of China is
Chongqing
Beijing
Shanghai
Xian
Xianggang
…
Washington, D.C.
Paris
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
118
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Imagine you are a LLM… how will you answer this?
2+2=
3
0
1
2
4
…
#
#
5
?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
119
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Imagine you are a LLM… how will you answer this?
*see George Orwell’s 1984 or the song by Radiohead inspired by it. 🤓
2+2=
3
0
1
2
4
…
#
#
5
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
120
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
LLM does not learn truth… �it learns statistical structure from large text corpus…
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
121
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
122
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
What are tokens?
ℳ
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
123
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
124
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Text Completion Model
床前明月__
光
An Intuitive Example
《静夜思》, 李白 (Li Bai)
ℳ
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
125
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Imagine you are a LLM… how will you answer this?
如
光
照
清
在
…
霜
秋
似
床前明月__
《静夜思》, 李白 (Li Bai)
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
126
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Text Completion Model
To be or not __
to be…
An Intuitive Example
<<Hamlet>>, William Shakespeare
ℳ
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
127
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Switzerland is…
orderly
scenic
beautiful
wealthy
demorcratic
…
poor
dirty
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
128
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Generative Modelling : Top-K Sampling
The coolest city of China is
Beijing
Shanghai
Xian
Chongqing
Xianggang*
…
Washington, D.C.
Paris
The coolest city in China is Chongqing, known for its stunning mountainous landscapes, spicy cuisine, and vibrant nightlife scene,…
The coolest city in China is Beijing, known for its rich history, vibrant culture, and bustling street life…
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
129
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
How do we train LLMs?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
130
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
It was the best of times, it was the worst of times…
<<A Tale of Two Cities>>, Charles Dickens
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
131
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Text Completion Model
An Intuitive Example
<<A Tale of Two Cities>>, Charles Dickens
It was the best of times, it was the worst of times…
was
the
best
times
worst
…
how
they
It …
ℳ
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
132
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Text Completion Model
An Intuitive Example
<<A Tale of Two Cities>>, Charles Dickens
It was the best of times, it was the worst of times…
was
the
best
times
worst
…
how
they
It …
ℳ
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
133
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Text Completion Model
An Intuitive Example
<<A Tale of Two Cities>>, Charles Dickens
It was the best of times, it was the worst of times…
was
the
best
times
worst
…
how
they
It
ℳ
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
134
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Text Completion Model
An Intuitive Example
<<A Tale of Two Cities>>, Charles Dickens
It was the best of times, it was the worst of times…
was
the
best
times
worst
…
how
they
It
was
ℳ
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
135
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Text Completion Model
An Intuitive Example
<<A Tale of Two Cities>>, Charles Dickens
It was the best of times, it was the worst of times…
was
the
best
times
worst
…
how
they
It
the
was
ℳ
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
136
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
So we continue to infer… one token at a time.
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
137
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
What about embeddings?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
138
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Artifical Neural Network
……
INPUT
HIDDEN
OUTPUT
l = 0
l = 1
l = L
l = 2
W(0)
W(1)
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
139
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Text Completion Model
An Intuitive Example
<<A Tale of Two Cities>>, Charles Dickens
It was the best of times, it was the worst of times…
was
the
best
times
worst
…
how
they
It
the
was
x1
xD
…
x1
xD
…
+
ℳ
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
140
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
But what was wrong with our silly example?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
141
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Does “It was the” always need to be followed by the “best of times”?
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
142
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
A language model is not learning a single sentence.�It is learning the statistical structure of language across billions of contexts.
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
143
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Context Matters!
Words do not follow each other deterministically.�Their probabilities depend on context.
�Give LLMs specificies!
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
144
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
General Matters
All About Neural Networks
Basics
Extension
[Break]
Generative Modelling
Traditional
LLMs
[Break]
Course Project
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
145
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
General Matters
All About Neural Networks
Basics
Extension
[Break]
Generative Modelling
Traditional
LLMs
[Break]
Course Project
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
146
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Course Project Support
Course Project Discussions
Thoughtful instructor listening as student teams discuss their projects in a bright university classroom. One team presents near a whiteboard with simple AI diagrams (data → model → output) while other teams watch attentively. Students are engaged, smiling, and collaborative. Natural candid classroom photography.
Generated with ChatGPT (OpenAI), 2026.
ACTIVITY
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
147
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Course Project Support
Course Project Discussions
ACTIVITY
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
148
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU
Thank You for Your Attention!
CCAI 9012 : GenAI Solutions to Global Challenges: Using AI Creatively and Responsibly
2026.03.04
149
Kam-Ming Mark TAM | Hongshan GUO | Waishan QIU