1 of 12

NGS Quality Control and preprocessing

2 of 12

Universal Raw Data Processing Concepts

Estimating Base Quality

  • Understanding raw data production
  • Technology specific error models
  • Common representation of error
  • Trimming bad bases

Trimming of introduced sequences

  • Library production errors
  • Vectors/Adaptors/MID Barcodes

Removal of non-target sequences

  • Identifying possible contaminants
  • Non-nuclear DNAs
  • Signal normalisation

3 of 12

Estimating base quality: Common representation of base quality | fasta, qual, and fastq files

fasta

qual

Estimate of

probability of error

Phred quality score from 0 to 93 using (usually <60) using offset ASCII

fastq

4 of 12

Paired end sequencing: Illumina

  • Insert size of 200-800 bases

  • If 200-250 bp then small over-lapping contigs can be created before assembly.

  • Pair end sequences with known insert sizes can help bridge difficult to resolve section of DNA (repeats)

  • Pair end sequences can be used informatically as a ‘double’ check.

  • Either 2xFastq files created or these can be spliced together to give reverse and forward of same fragment consecutively on the sequence

First question a bioinformatician will always ask you:

“Single or paired?”

5 of 12

Trimming of introduced Sequences: �Multiplexing Identifier Adaptors (MID tags)

Commonly referred to as

Indexes or Barcodes or MIDs or Tags

Usually done by sequencing centre, but not always.

We will look at different ways to import into Qiime later!

6 of 12

Trimming of Introduced sequences:�Biggest risk: Sequencing barcodes or adapters

400bp

250bp

250bp

200bp

250bp

7 of 12

Next Generation Sequencing Platforms:�Platform Heterogeneity

Illumina

Nanopore

Pacific Biosystems

Platform specific errors and adaptor sequences

8 of 12

Assessing Sequence data quality

FastQC

Qiime

(We’ll look at both of these in the practical sessions)

9 of 12

Quality filtering

? Trim first base <30

Base filtering

10 of 12

Quality filtering

Trim if average of 5bp <30

Average:�35

Average:�34

Average:�37

Average:�31

Average:�30

Average:�29

Sliding window Trimming

11 of 12

Overlapping reads

250bp

250bp

450bp Amplicon region

50bp overlap

235bp

223bp

450bp Amplicon region

trim

7bp overlap

0bp overlap

200bp

235bp

450bp Amplicon region

trim

12 of 12

Quality Controlling your data in Qiime2 (Dada2)

Filter by quality/length

    • Remove low quality bases (usually from read ends)

Denoise

    • Amplicon specific process due to ‘noisy’ PCR process

Chimera Checking

    • Positive filter against known amplicon structure

Clean data ready for processing!