1
1/15/25
Lectures 3 & 4
Medical Image Processing - Basics
BME 495:
Deep Learning for Medical Imaging
Ulas Bagci, Ph.D.,
Director of Machine & Hybrid Intelligence Lab,�Northwestern University, Chicago
Machine & Hybrid Intelligence Lab
Outline of Lectures 3 & 4
Image Pre-Processing
Basics & Definitions
Filters
Machine & Hybrid Intelligence Lab
3
Machine & Hybrid Intelligence Lab
4
CAD: Computer Aided Diagnosis
Science of underlying computerized methods for the diagnosis of diseases via images
Machine & Hybrid Intelligence Lab
5
CAD: Computer Aided Diagnosis
Science of underlying computerized methods for the diagnosis of diseases via images
Machine & Hybrid Intelligence Lab
6
CAD: Computer Aided Diagnosis
Science of underlying computerized methods for the diagnosis of diseases via images
Machine & Hybrid Intelligence Lab
7
CAD: Computer Aided Diagnosis
Science of underlying computerized methods for the diagnosis of diseases via images
Storage requirement can be reduced by a factor of 2-10
Machine & Hybrid Intelligence Lab
VOI/ROI (Volume/Region of Interest)
8
Machine & Hybrid Intelligence Lab
VOI/ROI (Volume/Region of Interest)
9
CUT
CUT
CUT
Machine & Hybrid Intelligence Lab
VOI/ROI (Volume/Region of Interest)
10
Kidney region
Machine & Hybrid Intelligence Lab
VOI/ROI (Volume/Region of Interest)
11
Machine & Hybrid Intelligence Lab
Spatial Resolution
12
(DPI: dots per inch)
Machine & Hybrid Intelligence Lab
13
Spatial Resolution
Machine & Hybrid Intelligence Lab
14
Machine & Hybrid Intelligence Lab
Contrast Resolution
15
Local change in brightness and defined as the ratio between average brightness of an object and background
Machine & Hybrid Intelligence Lab
Radiographic Contrast
16
C: Center,
W: Width
Machine & Hybrid Intelligence Lab
Image Histogram ?
17
Machine & Hybrid Intelligence Lab
18
Image Histogram
It plots the number of pixels for each intensity value.
Machine & Hybrid Intelligence Lab
19
Image Histogram – Example Reading
Machine & Hybrid Intelligence Lab
20
Image Histogram – Example
Machine & Hybrid Intelligence Lab
Histogram based analysis of Lung CT (credit: Imbio)
21
Machine & Hybrid Intelligence Lab
Pixel Transformation
22
Machine & Hybrid Intelligence Lab
Pixel Transformation
23
X
Machine & Hybrid Intelligence Lab
Image Filtering
24
Purpose: To suppress unwanted (non-object) info.
To enhance wanted (object) information.
Machine & Hybrid Intelligence Lab
Image Filtering
25
Purpose: To suppress unwanted (non-object) info.
To enhance wanted (object) information.
Enhancive: For enhancing edges, regions.
For intensity scale standardization.
For correcting background variation.
Suppressive: Mainly for suppressing random noise.
Machine & Hybrid Intelligence Lab
Filters - Core component of DEEP LEARNING
26
Machine & Hybrid Intelligence Lab
Filters - Core component of DEEP LEARNING
27
Machine & Hybrid Intelligence Lab
Filters - Core component of DEEP LEARNING
28
Machine & Hybrid Intelligence Lab
Core DL�Filtering
29
Machine & Hybrid Intelligence Lab
Image Filtering
30
Machine & Hybrid Intelligence Lab
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 0 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 90 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| | | | | | | | | |
| 0 | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 0 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 90 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Credit: S. Seitz
Image filtering
1
1
1
1
1
1
1
1
1
Machine & Hybrid Intelligence Lab
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 0 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 90 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| | | | | | | | | |
| 0 | 10 | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 0 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 90 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Image filtering
1
1
1
1
1
1
1
1
1
Credit: S. Seitz
Machine & Hybrid Intelligence Lab
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 0 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 90 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| | | | | | | | | |
| 0 | 10 | 20 | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 0 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 90 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Image filtering
1
1
1
1
1
1
1
1
1
Credit: S. Seitz
Machine & Hybrid Intelligence Lab
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 0 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 90 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| | | | | | | | | |
| 0 | 10 | 20 | 30 | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 0 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 90 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Image filtering
1
1
1
1
1
1
1
1
1
Credit: S. Seitz
Machine & Hybrid Intelligence Lab
| | | | | | | | | |
| 0 | 10 | 20 | 30 | 30 | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 0 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 90 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Image filtering
1
1
1
1
1
1
1
1
1
Credit: S. Seitz
Machine & Hybrid Intelligence Lab
| | | | | | | | | |
| 0 | 10 | 20 | 30 | 30 | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 0 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 90 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Image filtering
1
1
1
1
1
1
1
1
1
Credit: S. Seitz
?
Machine & Hybrid Intelligence Lab
| | | | | | | | | |
| 0 | 10 | 20 | 30 | 30 | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | 50 | | | | | |
| | | | | | | | | |
| | | | | | | | | |
| | | | | | | | | |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 0 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 90 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Image filtering
1
1
1
1
1
1
1
1
1
Credit: S. Seitz
?
Machine & Hybrid Intelligence Lab
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 0 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 90 | 90 | 90 | 90 | 90 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 90 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| | | | | | | | | |
| 0 | 10 | 20 | 30 | 30 | 30 | 20 | 10 | |
| 0 | 20 | 40 | 60 | 60 | 60 | 40 | 20 | |
| 0 | 30 | 60 | 90 | 90 | 90 | 60 | 30 | |
| 0 | 30 | 50 | 80 | 80 | 90 | 60 | 30 | |
| 0 | 30 | 50 | 80 | 80 | 90 | 60 | 30 | |
| 0 | 20 | 30 | 50 | 50 | 60 | 40 | 20 | |
| 10 | 20 | 30 | 30 | 30 | 30 | 20 | 10 | |
| 10 | 10 | 10 | 0 | 0 | 0 | 0 | 0 | |
| | | | | | | | | |
Image filtering
1
1
1
1
1
1
1
1
1
Credit: S. Seitz
Machine & Hybrid Intelligence Lab
Median Filters (non-linear)
39
Machine & Hybrid Intelligence Lab
Median Filters (non-linear)
40
Machine & Hybrid Intelligence Lab
Filtering X-ray
41
Machine & Hybrid Intelligence Lab
Unsharp Masking�Lower Noise, Higher Contrast
42
histogram
histogram
Machine & Hybrid Intelligence Lab
Unsharp Masking
43
Machine & Hybrid Intelligence Lab
Unsharp Masking
44
Smoothed image
(low pass)
Edge enhanced image
(high pass)
Machine & Hybrid Intelligence Lab
Unsharp Masking
Reminder: Edges are located in high frequency of the images!
45
Smoothed image
(low pass)
Edge enhanced image
(high pass)
Machine & Hybrid Intelligence Lab
Hand X-ray Unsharp Masking (alpha=0.5)
46
Original Image
Enhanced Image
Machine & Hybrid Intelligence Lab
Unsharp Masking: Example CT (head, axial)
47
Original CT Data
Filtered CT Data
Machine & Hybrid Intelligence Lab
Adaptive Filtering: Example head MRA
48
MIP of MRA data before filtering
MIP of MRA data after filtering
Machine & Hybrid Intelligence Lab
Adaptive Filtering: Example brain MRI
49
Original brain MRI
Enhanced brain MRI
Note the improved contrast between brain and CSF (cerebrospinal fluid)
Machine & Hybrid Intelligence Lab
50
Enhanced brain MRI
Note the improved contrast between brain and CSF (cerebrospinal fluid)
Adaptive Filtering: Example brain MRI (zoom)
Machine & Hybrid Intelligence Lab
Smoothing MRI (Denoising)
51
Machine & Hybrid Intelligence Lab
52
Machine & Hybrid Intelligence Lab
53
Machine & Hybrid Intelligence Lab
How to measure for evaluating noise removal algorithms?
54
SNR: Signal to Noise Ratio
CNR: Contrast to Noise Ratio
Machine & Hybrid Intelligence Lab
How to measure for evaluating noise removal algorithms?
55
SNR: Signal to Noise Ratio
CNR: Contrast to Noise Ratio
Machine & Hybrid Intelligence Lab
How to measure for evaluating noise removal algorithms?
56
SNR: Signal to Noise Ratio
CNR: Contrast to Noise Ratio
Machine & Hybrid Intelligence Lab
How to measure for evaluating noise removal algorithms?
57
SNR: Signal to Noise Ratio
CNR: Contrast to Noise Ratio
CNR=6
Machine & Hybrid Intelligence Lab
58
SNR (S/N) (of normal brain) and CNR (C/N) of multiple sclerosis plaques to normal brain on spin-density and T1 magnetic resonance images.
Machine & Hybrid Intelligence Lab
Thresholding
59
Machine & Hybrid Intelligence Lab
Example: CT Scan
60
Machine & Hybrid Intelligence Lab
Example: CT Scan
61
Machine & Hybrid Intelligence Lab
Example: CT Scan
62
Machine & Hybrid Intelligence Lab
Example: CT Scan
63
Machine & Hybrid Intelligence Lab
Example: CT Scan
64
Machine & Hybrid Intelligence Lab
Thresholding Methods
65
Machine & Hybrid Intelligence Lab
Example for PET Thresholding
66
ITM for tumor segmentation/FDG PET
Machine & Hybrid Intelligence Lab
Example for PET Thresholding
67
Machine & Hybrid Intelligence Lab
Further Thresholding Example – CT Bones
68
Machine & Hybrid Intelligence Lab
Further Thresholding Example – CT Bones
69
Machine & Hybrid Intelligence Lab
Head-Neck CT – Thresholding for Skull Modeling
70
(Slice Credit: P.Seutens)
Segmentation of the skull and the mandibula in CT images using thresholding. (a) Original CT image of the head. (b) Result with a threshold value of 276 Hounsfield units. The segmented bony structures are represented in color. (c) 3D rendering of the skull shows a congenital growth deficiency of the mandibula in this 8-year-old patient. This information was used preoperatively to plan a repositioning of the mandibula.
Machine & Hybrid Intelligence Lab
Multiple Thresholds – MRI Thresholding
71
Thresholding can be done interactively and separates the image into different regions. Valleys in the histogram indicate potentially useful threshold values
Credit: Toeonies, K.
Machine & Hybrid Intelligence Lab
MRI Inhomogeneity Correction �(Bias Field Correction)
72
Machine & Hybrid Intelligence Lab
Magnetic Field Inhomogeneity
73
Field inhomogeneity is measured in
parts per million (ppm)
with respect to the external field
Different tissues have different magnetic susceptibilities
⇨ distortions in magnetic field
distortions are most noticeable near air-tissue interfaces
Credit: K.Friston
Machine & Hybrid Intelligence Lab
MR Intensity Inhomogeneity
74
(credit: R.Gupta)
Machine & Hybrid Intelligence Lab
Intensity Inhomogeneity Correction Methods
75
Original Image
Inhomogeneity Field
Corrected Image
Machine & Hybrid Intelligence Lab
Bias Correction Approaches
Numerous methods have been published in the last three decades
76
Machine & Hybrid Intelligence Lab
Prospective Approaches-Filtering/Surface Fitting
Rat brain MRI: a. Original image. b: after inhomogeneity
correction with the phantom based correction algorithm.
Credit: Hui et al, JMRI 2010.
Machine & Hybrid Intelligence Lab
78
Original
Corrected
Machine & Hybrid Intelligence Lab
Coefficient of Variation as a quantitative evaluation metric
79
Machine & Hybrid Intelligence Lab
Coefficient of Variation as a quantitative evaluation metric
80
Machine & Hybrid Intelligence Lab
Coefficient of Variation as a quantitative evaluation metric
81
Machine & Hybrid Intelligence Lab
Coefficient of Variation as a quantitative evaluation metric
82
Machine & Hybrid Intelligence Lab
Coefficient of Variation as a quantitative evaluation metric
83
Machine & Hybrid Intelligence Lab
Coefficient of Variation as a quantitative evaluation metric
84
Machine & Hybrid Intelligence Lab
Coefficient of Variation as a quantitative evaluation metric
85
Machine & Hybrid Intelligence Lab
MRI Intensity Standardization
86
Machine & Hybrid Intelligence Lab
MR Intensity Non-Standardness
87
Machine & Hybrid Intelligence Lab
MR Intensity Non-Standardness
88
Machine & Hybrid Intelligence Lab
MR Intensity Non-Standardness
PD PD T2 T2
89
Machine & Hybrid Intelligence Lab
MR Intensity Non-Standardness
PD PD T2 T2
90
Machine & Hybrid Intelligence Lab
What is changed now?
91
Machine & Hybrid Intelligence Lab
Intensities are standardized!
92
Machine & Hybrid Intelligence Lab
Intensity Non-Standardness
by using the same pulse sequence
93
Machine & Hybrid Intelligence Lab
Intensity Non-Standardness
94
same brain slice,
same person,
same scanners,
different imaging times,
intensities are significantly
different for the same
Tissue type!
by using the same pulse sequence
Machine & Hybrid Intelligence Lab
95
10 Different
PD studies
ORIGINAL
HISTOGRAMS
Credit: L. Nyul
Machine & Hybrid Intelligence Lab
96
10 Different
PD studies
ORIGINAL
HISTOGRAMS
BACKGROUND
FOREGROUND
Credit: L. Nyul
Machine & Hybrid Intelligence Lab
97
10 Different
PD studies
ORIGINAL
HISTOGRAMS
BACKGROUND
FOREGROUND
AFTER STANDARDIZATION
Credit: L. Nyul
Machine & Hybrid Intelligence Lab
98
Original
Gray Scale
After Intensity
Standardization
Credit: L. Nyul
Machine & Hybrid Intelligence Lab
How to Standardize MRI Intensities?
99
Machine & Hybrid Intelligence Lab
How to Standardize MRI Intensities?
100
Machine & Hybrid Intelligence Lab
How to Standardize MRI Intensities?
101
Mono-modal
Bi-modal
Machine & Hybrid Intelligence Lab
How to Standardize MRI Intensities?
102
Mono-modal
Bi-modal
Minimum
intensity
Maximum
intensity
Second mode
Of the histogram
Shoulder of the
Background hump
Minimum and maximum
Percentile intensities
Machine & Hybrid Intelligence Lab
How to Standardize MRI Intensities?
103
Mono-modal
Bi-modal
Minimum
intensity
Maximum
intensity
Second mode
Of the histogram
Shoulder of the
Background hump
Minimum and maximum
Percentile intensities
Machine & Hybrid Intelligence Lab
How to Standardize MRI Intensities?
104
Mono-modal
Bi-modal
Minimum
intensity
Maximum
intensity
Second mode
Of the histogram
Shoulder of the
Background hump
Minimum and maximum
Percentile intensities
Machine & Hybrid Intelligence Lab
How to Standardize MRI Intensities?
105
Mono-modal
Bi-modal
Minimum
intensity
Maximum
intensity
Second mode
Of the histogram
Shoulder of the
Background hump
Minimum and maximum
Percentile intensities
Machine & Hybrid Intelligence Lab
How to Standardize MRI Intensities?
106
Mono-modal
Bi-modal
Minimum
intensity
Maximum
intensity
Second mode
Of the histogram
Shoulder of the
Background hump
Minimum and maximum
Percentile intensities
Machine & Hybrid Intelligence Lab
Map background and foreground into the fixed intensity regions!
107
🡨Location of different modes
Machine & Hybrid Intelligence Lab
Map background and foreground into the fixed intensity regions!
108
Fixed (standardized modes)
Machine & Hybrid Intelligence Lab
109
IMAGE SCALE
STANDARD SCALE
m1i
p1i
μi
p2i
m2i
s’1i
s’2i
s1
s2
μs
Machine & Hybrid Intelligence Lab
110
IMAGE SCALE
STANDARD SCALE
m1i
p1i
μi
p2i
m2i
s’1i
s’2i
s1
s2
μs
(known, fixed)
Machine & Hybrid Intelligence Lab
111
IMAGE SCALE
STANDARD SCALE
m1i
p1i
μi
p2i
m2i
s’1i
s’2i
s1
s2
μs
(known, fixed)
for a given image i,
we must calculate
these parameters from
histogram and then
transform them into
the standard scale
values.
Machine & Hybrid Intelligence Lab
112
IMAGE SCALE
STANDARD SCALE
m1i
p1i
μi
p2i
m2i
s’1i
s’2i
s1
s2
μs
(known, fixed)
Machine & Hybrid Intelligence Lab
113
IMAGE SCALE
STANDARD SCALE
m1i
P1i x
μi
p2i
m2i
s’1i
s’2i
s1
s2
μs
(known, fixed)
Machine & Hybrid Intelligence Lab
114
IMAGE SCALE
STANDARD SCALE
m1i
P1i x
μi
p2i
m2i
s’1i
s’2i
s1
s2
μs
(known, fixed)
Machine & Hybrid Intelligence Lab
Intensity Mapping Function
115
Machine & Hybrid Intelligence Lab
Standardized Intensity Mapping T1-MRI
116
Original Scale
Standard Scale
Machine & Hybrid Intelligence Lab
How to determine standardized parameters?
117
One way is to have some training images,
and find average values (or median) for
Histogram parameters
Machine & Hybrid Intelligence Lab
Foot MRI Intensity Standardization
118
Original Scale
Standard Scale
Machine & Hybrid Intelligence Lab
Different Body region, MR Modality, and Subjects for Training? (mixed training)
119
Machine & Hybrid Intelligence Lab
Quantitative Comparisons
120
Credit: L. Nyul
Machine & Hybrid Intelligence Lab
Interplay between Denoising, Bias Correction, and Intensity Standardization ?
121
Denoising
Intensity Standardization
Bias Correction
Intensity Standardization
Bias Correction
Denoising
Bias Correction
Denoising
Intensity Standardization
Bias Correction
Intensity Standardization
Denoising
(A)
(B)
(C)
(D)
Machine & Hybrid Intelligence Lab
Interplay between Denoising, Bias Correction, and Intensity Standardization ?
122
Denoising
Intensity Standardization
Bias Correction
Intensity Standardization
Bias Correction
Denoising
Bias Correction
Denoising
Intensity Standardization
Bias Correction
Intensity Standardization
Denoising
(A)
(B)
(C)
(D)
Machine & Hybrid Intelligence Lab
Effects of Intensity Standardization on Image Registration
123
Machine & Hybrid Intelligence Lab
Effects of Intensity Standardization on Image Segmentation
124
Before standardization
After standardization
Machine & Hybrid Intelligence Lab
Summary
125
Machine & Hybrid Intelligence Lab
References and Slide Credits
126
Machine & Hybrid Intelligence Lab
127
Thank you for listening!
Ulas Bagci, Ph.D.,
Associate Professor,
Director of Machine & Hybrid Intelligence Lab,
Department of Radiology, Feinberg School of Medicine,
Department of Biomedical Engineering (Courtesy),
Department of Electrical and Computer Engineering (Courtesy)
Northwestern University,
737 N. Michigan Avenue Suite 1600,
Chicago, IL 60611, USA
Phone: +1 312-694-4951�Cell: +1 240 383 8587�
Machine & Hybrid Intelligence Lab