1 of 40

Principles and applications for monitoring and assessing underground cavities sites

Dr. Zili Li

​

Lecturer (tenured Assistant Professor)

in Geotechnical Engineering

University College Cork

Irish Centre for Applied Geoscience (iCRAG)

​

zili.li@ucc.ie

1

2 of 40

Who am I ?

Zili Li

Professional areas:

Underground space technology, Innovative monitoring technology,

Internet of things, big data analytics in geotechnics

Education & Work

Location

Time

Bachelor in Civil Engineering

Tongji University, China

2006.9 – 2010.7

Ph.D. in Geotechnical Engineering

University of Cambridge, UK

2010.10 – 2014.10

Postdoctoral Research Fellow

Colorado School of Mines, US

2014.2 – 2015.3

Research Associate

University of Cambridge, UK

2015.5 – 2016.5

Lecturer

University College Cork, Ireland

2016.5 – Present

3 of 40

Content

​

​

​

​

​

  • Wireless sensor network
  • Distributed fibre optic sensing
  • Drone inspection and image-based automatic assessment

​

​

​

​

Innovative monitoring and assessment technologies for underground sites

4 of 40

Content

​

​

​

​

​

  • Wireless sensor network
  • Distributed fibre optic sensing
  • Drone inspection and image-based automatic assessment

​

​

​

​

Innovative monitoring and assessment technologies for underground sites

5 of 40

Wireless Sensor Network

(in real time or continuous time)

Wireless sensor network

Data

transmitting

Gateway

Displacement gauge

/ Crackmeter

Dublin Port Tunnel monitoring in partnership with TII

Mobile network

Gateway

6 of 40

Tunnel surface spalling

Cracks at the tunnel springline

water leakage and crack at the tunnel crown

Structural deterioration at Dublin Port Tunnel

A Cross passage at Dublin Port Tunnel

Dublin Port Tunnel

7 of 40

WSN Monitoring the performance of Dublin Port Tunnel

The long-term ageing behaviour of a cross passage at Dublin Port Tunnel

Tunnel deteriorations

Water leakage; concrete cracks; concrete corrosion; concrete spalling

WSN monitoring

Structural inclination

Structural movement

Crack development

14 tiltmeters

2 crackmeters

2 gateways

8 of 40

Monitoring the performance of Dublin Port Tunnel

The long-term ageing behaviour of a critical section of Dublin Port Tunnel

WSN monitoring of aging road tunnel

Inclinometer ring on central Layby Tunnel (Northbound)

T4: B axis: 0.0100°/month, counter clockwise

T6: A axis: 0.0048°/month, clockwise

T5: B axis: 0.0049°/month, counter clockwise

The upper part of layby tunnel lining is tilting inwards the tunnel.

Observed tunnel deformation rate is much greater than that predicted by finite element models!

9 of 40

WSN monitoring of Underground World Heritage

WSN Monitoring for Dolmen de Antelas in Aveiro, Portugal

Dolmen de Antelas in Aveiro, Portugal

9

10 of 40

Structural parameter: inclination, crack development, distance change

Inclination development

inclination development

Environmental sensor: CO2, temperature, relative humidity

Wireless Sensors

CO2 change during experiment

Crack development with time

10

11 of 40

Content

​

​

​

​

​

  • Wireless sensor network
  • Distributed fibre optic sensing
  • Drone inspection and image-based automatic assessment

​

​

​

​

Innovative monitoring and assessment technologies for underground sites

12 of 40

Fibre optic cable

Distributed fibre optical sensing (in 3D continuous space)

Optical Analyser

​

  • Continuous strain measurement
  • Low cost of the optic fibre cables
  • Resistant to corrosion and water
  • Easy to integrate/install

…

​

Main advantages:

13 of 40

Diaphragm wall cage

Spool for cables

Fibre optical cables

14 of 40

Comparison between DFOS and other field data

Incremental lateral displacement along the D-wall

15 of 40

Fibre optic cable deployment at CERN Tunnel

the European Organization for Nuclear Research

near Geneva, Switzerland

CERN: Conseil Européen pour la Recherche Nucléaire

2013

Higgs boson

16 of 40

Installation of Fibre Optic Sensors: CERN tunnel

Optical analyser

Cables loops

Shaft

17 of 40

OUTPUT

Axial strain

Tunnel side

CUT DATA

INPUT

Fibre optical data analysis

Crown

Tunnel side

Development of tunnel strain with structural deterioration in the long term

18 of 40

Content

​

​

​

​

​

  • Wireless sensor network
  • Distributed fibre optic sensing
  • Drone inspection and image-based automatic assessment (by Ms. Ran Zhang)

​

​

​

​

Innovative monitoring and assessment technologies for underground sites

19 of 40

Tunnel Cracks

20 of 40

Camera on a robotic arm at CERN

Image data acquisition methods

Manual inspection and take pictures

21 of 40

Drone tunnel inspection

Tunnel shaft inspection at CERN

Drone inspection

Centreline location for drone flight

Pilot certificate for drone operation

22 of 40

  • Tunnel condition for drone inspection
    • No wind
    • Low luminance (Compensated with spotlight)
    • Low / denied GPS signal
    • Obstacle avoidance (obstacle distance, stop at 1m)

​

Drone tunnel inspection

  • Drone tunnel inspection procedure
    • Crack and surface inspection using optic camera
    • Water seepage inspection using infrared camera
    • Flight at different heights
    • Flight at constant distance to the tunnel wall

infrared camera

23 of 40

No spotlight

With spotlight

Photos taken at different heights

24 of 40

Content

​

​

​

​

​

  • Wireless sensor network
  • Distributed fibre optic sensing
  • Drone inspection and image-based automatic assessment

​

​

​

​

Innovative monitoring and assessment technologies for underground sites

25 of 40

Image pre-processing procedures

Fig 1 original image

Fig 2 after radical filter

Fig 3 after dehaze

Apply the same setting to all images in one task

26 of 40

Image stitching

4 Original images

1 Stitched image

27 of 40

  • ~350 tunnel images
  • Each image was cropped to 256 x 256 pixels in uniform size
  • A database of 7600 small images was created

Create a Data Base- Image segmentation

28 of 40

Content

​

​

​

​

​

  • Wireless sensor network
  • Distributed fibre optic sensing
  • Drone inspection and image-based automatic assessment

​

​

​

​

Innovative monitoring and assessment technologies for underground sites

29 of 40

In Deep Learning, the most commonly adopted method of image analyzation is based on Convoluted Neural Networks(CNN).

Convoluted Neural Networks(CNN)

30 of 40

Unlike conventional CNN development from scratch, the proposed CNN incorporates transfer learning in the form of the VGG16 model with weights transferred from ImageNet.

Transfer Learning

The transfer learning models are trained using over 10k+ images validated on 2’500 images with 256 x 256 pixels in uniform size

ImageNet:  More than 14 million images

VGG16 model

31 of 40

Original Image

Scanning window Pass 1

1

2

3

4

5

6

7

8

9

10

11

12

2

​

​

​

​

​

​

​

​

​

​

​

3

​

​

​

​

​

​

​

​

​

​

​

4

​

​

​

​

​

​

​

​

​

​

​

5

​

​

​

​

​

​

​

​

​

​

​

6

​

​

​

​

​

​

​

​

​

​

​

7

​

​

​

​

​

​

​

​

​

​

​

8

​

​

​

​

​

​

​

​

​

​

​

9

​

​

​

​

​

​

​

​

​

​

​

10

​

​

​

​

​

​

​

​

​

​

​

11

​

​

​

​

​

​

​

​

​

​

​

12

​

​

​

​

​

​

​

​

​

​

​

32 of 40

Original Image

Prediction Made

33 of 40

CNN for crack Detection

The CNN achieved a accuracy of high results in training of 98.7 %, and out of sample accuracy of 97.9%. The integration of scanning window method into the CNN increased the accuracy.

34 of 40

Content

​

​

  1. Innovative field monitoring technologies for big data acquisition

​

​

2. Image processing and deep learning

  • Image pre-processing
  • Crack detection
  • Crack classification

​

​

​

35 of 40

Automatically classify the cracks into 4 categorise

​

following road tunnel civil engineering inspection guidebook:

​

  1. Vertical structural cracks
  2. Horizontal structural cracks
  3. Diagonal structural cracks
  4. Crescent/Complex structural cracks

​

Vertical

Horizontal

Diagonal

Complex

Crack types

36 of 40

Crack Classification

  1. Vertical structural cracks= Blue box
  2. Horizontal structural cracks= Red Box
  3. Diagonal structural cracks =Green Box
  4. Complex structural cracks = Black Box

1

2

3

4

5

6

7

8

9

10

11

12

2

​

​

​

​

​

​

​

​

​

​

​

3

​

​

​

​

​

​

​

​

​

​

​

4

​

​

​

​

​

​

​

​

​

​

​

5

​

​

​

​

​

​

​

​

​

​

​

6

​

​

​

​

​

​

​

​

​

​

​

7

​

​

​

​

​

​

​

​

​

​

​

8

​

​

​

​

​

​

​

​

​

​

​

9

​

​

​

​

​

​

​

​

​

​

​

10

​

​

​

​

​

​

​

​

​

​

​

11

​

​

​

​

​

​

​

​

​

​

​

12

​

​

​

​

​

​

​

​

​

​

​

37 of 40

The test metrics for the crack classification model

  • CNN model training : 1.5h (55 epochs)
  • Scanning window prediction:
    • 11 min for task 3: 33 images of 501 MB
    • 25 min for task 4: 74 images of 1.24GB
    • 50 min for task 5: 150 images of 2.18 GB
    • 5 min for task 6: 17 images of 239 MB
    • 20 s per image

38 of 40

Image Name

​

​

Predicted label

horizontal-10.png

True positive

​

Horizontal

horizontal-113.png

​

False negative

Diagonal

horizontal-116.png

True positive

​

Horizontal

horizontal-130.png

True positive

​

Horizontal

horizontal-156.png

True positive

​

Horizontal

horizontal-16.png

True positive

​

Horizontal

horizontal-161.png

True positive

​

Horizontal

horizontal-187.png

​

False negative

No Crack

horizontal-189.png

True positive

​

Horizontal

horizontal-193.png

True positive

​

Horizontal

horizontal-199.png

True positive

​

Horizontal

horizontal-21.png

True positive

​

Horizontal

horizontal-213.png

True positive

​

Horizontal

horizontal-214.png

True positive

​

Horizontal

horizontal-217.png

True positive

​

Horizontal

horizontal-3.png

True positive

​

Horizontal

horizontal-48.png

​

False negative

Vertical

horizontal-51.png

​

False negative

Diagonal

horizontal-52.png

True positive

​

Horizontal

horizontal-57.png

True positive

​

Horizontal

horizontal-58.png

True positive

​

Horizontal

horizontal-6.png

True positive

​

Horizontal

horizontal-60.png

True positive

​

Horizontal

horizontal-71.png

True positive

​

Horizontal

horizontal-72.png

​

False negative

No crack

horizontal-79.png

​

False negative

No crack

horizontal-81.png

True positive

​

Horizontal

horizontal-89.png

​

False negative

Diagonal

horizontal-91.png

True positive

​

Horizontal

horizontal-98.png

 

False negative

No crack

Horizontal-48

Horizontal-51

Horizontal-187

Crack classification result

39 of 40

Summary

​

  • Demonstrate the acquisition of comprehensive geotechnical & environmental ‘big’ data in real time using wireless sensor network (e.g. inclination, crack development, temperature)

​

  • Distributed fibre optic sensing acquires ‘big’ strain data of tunnel infrastructure in 3D space and reveals the time-dependent tunnel displacement profile

​

​

  • Drone inspection enables to gather large numbers of tunnel images following a standard procedure at a lower cost of time and labour.

​

  • The CNN algorithm is trained upon small images in uniform size. The scanning window technique facilitates the crack classification in a large image and increased the CNN prediction accuracy.

​

  • Compared to conventional CNN model trained from scratch, the transfer learning CNN model achieves a higher validation accuracy of 97.9% at a lower computational cost (e.g. 55 epochs).

40 of 40

Thank you for your attention.

Dr. Zili Li

​

zili.li@ucc.ie

​

40